[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:46:26 dist-test-slave-7z32 krb5kdc[27323](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:46:26 dist-test-slave-7z32 krb5kdc[27323](info): set up 2 sockets
Aug 06 11:46:26 dist-test-slave-7z32 krb5kdc[27323](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 11:46:28.124977 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.528s user 0.000s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:46:28 dist-test-slave-7z32 krb5kdc[27323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:46:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:46:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:46:28.309557 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40457
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:42675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:40457
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:28.460510 27339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:28.460906 27339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:28.460958 27339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:28.465783 27339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:46:28.465893 27339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:28.465915 27339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:28.465941 27339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:46:28.465960 27339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:46:28.472276 27339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:42675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:40457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:28.473557 27339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:28.474716 27339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:28.486231 27349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:28.486231 27345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:28.487102 27347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:28.488628 27339 server_base.cc:1034] running on GCE node
I20260806 11:46:28.489351 27339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:28.490798 27339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:28.494208 27339 hybrid_clock.cc:648] HybridClock initialized: now 1786016788494145 us; error 150 us; skew 500 ppm
Aug 06 11:46:28 dist-test-slave-7z32 krb5kdc[27323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016788, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:28.498167 27339 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:46:28.499464 27339 webserver.cc:460] Webserver started at http://127.26.172.254:42537/ using document root <none> and password file <none>
I20260806 11:46:28.500161 27339 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:28.500285 27339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:28.500515 27339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:28.502959 27339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "69946b3863834858a387f60a93bea4f8"
format_stamp: "Formatted at 2026-08-06 11:46:28 on dist-test-slave-7z32"
server_key: "e8366b5a0be4622fbc049e3322e1f957"
server_key_iv: "ba25009e1aa35b58c2b1c1b629e64de7"
server_key_version: "encryptionkey@0"
I20260806 11:46:28.503598 27339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "69946b3863834858a387f60a93bea4f8"
format_stamp: "Formatted at 2026-08-06 11:46:28 on dist-test-slave-7z32"
server_key: "e8366b5a0be4622fbc049e3322e1f957"
server_key_iv: "ba25009e1aa35b58c2b1c1b629e64de7"
server_key_version: "encryptionkey@0"
I20260806 11:46:28.508922 27339 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:46:28.512717 27362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:28.515105 27339 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 11:46:28.515373 27339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "69946b3863834858a387f60a93bea4f8"
format_stamp: "Formatted at 2026-08-06 11:46:28 on dist-test-slave-7z32"
server_key: "e8366b5a0be4622fbc049e3322e1f957"
server_key_iv: "ba25009e1aa35b58c2b1c1b629e64de7"
server_key_version: "encryptionkey@0"
I20260806 11:46:28.515548 27339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:28.537050 27339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:28.541594 27339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:28.541834 27339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:28.551672 27339 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:40457
I20260806 11:46:28.551761 27434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:40457 every 8 connection(s)
I20260806 11:46:28.552922 27339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:46:28.557471 27435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:28.562528 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 27339
I20260806 11:46:28.562811 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:46:28.565143 27315 external_mini_cluster.cc:1428] Setting key c21c417021ce4805962eb41908cbd37d
I20260806 11:46:28.568099 27435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8: Bootstrap starting.
I20260806 11:46:28.572455 27435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:28.573839 27435 log.cc:824] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:28.577809 27435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8: No bootstrap required, opened a new log
I20260806 11:46:28.584398 27435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69946b3863834858a387f60a93bea4f8" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40457 } }
I20260806 11:46:28.584961 27435 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:28.585068 27435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69946b3863834858a387f60a93bea4f8, State: Initialized, Role: FOLLOWER
I20260806 11:46:28.585835 27435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69946b3863834858a387f60a93bea4f8" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40457 } }
I20260806 11:46:28.586030 27435 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:46:28.586208 27435 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:46:28.586383 27435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:28.588306 27435 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69946b3863834858a387f60a93bea4f8" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40457 } }
I20260806 11:46:28.588884 27435 leader_election.cc:302] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69946b3863834858a387f60a93bea4f8; no voters:
I20260806 11:46:28.589417 27435 leader_election.cc:288] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:46:28.589671 27440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:28.590180 27440 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [term 1 LEADER]: Becoming Leader. State: Replica: 69946b3863834858a387f60a93bea4f8, State: Running, Role: LEADER
I20260806 11:46:28.590703 27440 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69946b3863834858a387f60a93bea4f8" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40457 } }
I20260806 11:46:28.591575 27435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:46:28.592837 27442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69946b3863834858a387f60a93bea4f8. Latest consensus state: current_term: 1 leader_uuid: "69946b3863834858a387f60a93bea4f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69946b3863834858a387f60a93bea4f8" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40457 } } }
I20260806 11:46:28.593020 27442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:28.593441 27441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69946b3863834858a387f60a93bea4f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69946b3863834858a387f60a93bea4f8" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40457 } } }
I20260806 11:46:28.593552 27441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:28.594134 27451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 06 11:46:28 dist-test-slave-7z32 krb5kdc[27323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016788, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:28.597998 27451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:46:28.606765 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:28.570995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60958 (local address 127.26.172.254:40457)
0806 11:46:28.571808 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:28.571834 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:28.573384 (+ 1550us) server_negotiation.cc:407] Connection header received
0806 11:46:28.579280 (+ 5896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:28.579311 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:28.579810 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:28.580320 (+ 510us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:28.585160 (+ 4840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:28.586718 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:28.589120 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:28.590039 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:28.590300 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:28.597918 (+ 7618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:28.597927 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:28.597946 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:28.597999 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:28.600744 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:28.601898 (+ 1154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:28.601908 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:28.601916 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:28.602170 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:28.602797 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:28.602802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:28.602804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:28.603706 (+ 902us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:28.603959 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:28.604996 (+ 1037us) server_negotiation.cc:299] Negotiation successful
0806 11:46:28.605462 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":251,"threads_started":1}
I20260806 11:46:28.607010 27451 catalog_manager.cc:1347] Generated new cluster ID: c062542c6c244bda98491a6ee2020b96
I20260806 11:46:28.607124 27451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:46:28.614390 27451 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:46:28.615984 27451 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:46:28.624828 27451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69946b3863834858a387f60a93bea4f8: Generated new TSK 0
I20260806 11:46:28.626134 27451 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:46:28.677012 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40457
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:42675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:28.854095 27467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:28.854616 27467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:28.854684 27467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:28.861409 27467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:28.861575 27467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:28.861660 27467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:46:28.869280 27467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:42675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40457
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:28.871101 27467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:28.873387 27467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:28.889439 27478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:28.889449 27476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:28.889449 27473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:28.890048 27467 server_base.cc:1034] running on GCE node
I20260806 11:46:28.891076 27467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:28.891994 27467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:28.895390 27467 hybrid_clock.cc:648] HybridClock initialized: now 1786016788895213 us; error 119 us; skew 500 ppm
Aug 06 11:46:28 dist-test-slave-7z32 krb5kdc[27323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016788, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:28.900076 27467 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:46:28.901466 27467 webserver.cc:460] Webserver started at http://127.26.172.193:33579/ using document root <none> and password file <none>
I20260806 11:46:28.902258 27467 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:28.902380 27467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:28.902681 27467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:28.905413 27467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "cae3a0e1fb034e6986978d4698399e0d"
format_stamp: "Formatted at 2026-08-06 11:46:28 on dist-test-slave-7z32"
server_key: "b1345f7736e8246c884b727ccac572fc"
server_key_iv: "e1870febd2df3dbc531442caa308ca5e"
server_key_version: "encryptionkey@0"
I20260806 11:46:28.906170 27467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "cae3a0e1fb034e6986978d4698399e0d"
format_stamp: "Formatted at 2026-08-06 11:46:28 on dist-test-slave-7z32"
server_key: "b1345f7736e8246c884b727ccac572fc"
server_key_iv: "e1870febd2df3dbc531442caa308ca5e"
server_key_version: "encryptionkey@0"
I20260806 11:46:28.911756 27467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 11:46:28.915736 27491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:28.918004 27467 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:46:28.918278 27467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "cae3a0e1fb034e6986978d4698399e0d"
format_stamp: "Formatted at 2026-08-06 11:46:28 on dist-test-slave-7z32"
server_key: "b1345f7736e8246c884b727ccac572fc"
server_key_iv: "e1870febd2df3dbc531442caa308ca5e"
server_key_version: "encryptionkey@0"
I20260806 11:46:28.918469 27467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:28.938930 27467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:28.943097 27467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:28.943339 27467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:28.944070 27467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:28.945093 27467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:28.945170 27467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:28.945250 27467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:28.945292 27467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:28.957742 27467 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:44723
I20260806 11:46:28.957794 27646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:44723 every 8 connection(s)
I20260806 11:46:28.958998 27467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:46:28.960696 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 27467
I20260806 11:46:28.960906 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:46:28.961294 27315 external_mini_cluster.cc:1428] Setting key 9b1e755d1cc20e46a2615856e0ef58d6
Aug 06 11:46:28 dist-test-slave-7z32 krb5kdc[27323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016788, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:46:28.983147 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:28.962149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:58317 (local address 127.26.172.254:40457)
0806 11:46:28.962341 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:28.962345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:28.963706 (+ 1361us) server_negotiation.cc:407] Connection header received
0806 11:46:28.965408 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:28.965412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:28.965482 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:28.965574 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:28.968659 (+ 3085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:28.969358 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:28.972077 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:28.972476 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:28.972643 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:28.977333 (+ 4690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:28.977338 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:28.977341 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:28.977384 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:28.979400 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:28.980440 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:28.980445 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:28.980446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:28.980585 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:28.981319 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:28.981324 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:28.981325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:28.981684 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:28.981836 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:28.982567 (+ 731us) server_negotiation.cc:299] Negotiation successful
0806 11:46:28.982810 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 11:46:28.984057 27651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:28.962689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40457 (local address 127.26.172.193:58317)
0806 11:46:28.963509 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:28.963574 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:28.965117 (+ 1543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:28.965863 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:28.965879 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:28.967130 (+ 1251us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:28.968290 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:28.968326 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:28.969618 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:28.969625 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:28.971634 (+ 2009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:28.971656 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:28.972779 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:28.972788 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:28.973145 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:28.974153 (+ 1008us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:28.974183 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:28.976958 (+ 2775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:28.979666 (+ 2708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:28.979685 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:28.979708 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:28.980231 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:28.980768 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:28.980772 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:28.980773 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:28.981122 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:28.981859 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:28.981867 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:28.982209 (+ 342us) client_negotiation.cc:769] Sending connection context
0806 11:46:28.982432 (+ 223us) client_negotiation.cc:240] Negotiation successful
0806 11:46:28.982928 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":233,"threads_started":1}
I20260806 11:46:28.986011 27649 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40457
I20260806 11:46:28.986408 27649 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:28.987247 27649 heartbeater.cc:511] Master 127.26.172.254:40457 requested a full tablet report, sending...
I20260806 11:46:28.989573 27383 ts_manager.cc:194] Registered new tserver with Master: cae3a0e1fb034e6986978d4698399e0d (127.26.172.193:44723)
I20260806 11:46:28.991202 27383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:58317
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:46:29.007653 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40457
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:42675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:29.173820 27654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:29.174316 27654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:29.174378 27654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:29.179790 27654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:29.179920 27654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:29.180006 27654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:46:29.186973 27654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:42675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40457
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:29.188849 27654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:29.190447 27654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:29.205682 27663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:29.205730 27661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:29.206174 27665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:29.206238 27654 server_base.cc:1034] running on GCE node
I20260806 11:46:29.207144 27654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:29.208084 27654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:29.211807 27654 hybrid_clock.cc:648] HybridClock initialized: now 1786016789211703 us; error 88 us; skew 500 ppm
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[27323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016789, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:29.216836 27654 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:46:29.218185 27654 webserver.cc:460] Webserver started at http://127.26.172.194:42615/ using document root <none> and password file <none>
I20260806 11:46:29.219051 27654 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:29.219167 27654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:29.219452 27654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:29.222393 27654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "28252252316d465c8d1ec28a504c17e0"
format_stamp: "Formatted at 2026-08-06 11:46:29 on dist-test-slave-7z32"
server_key: "73cf54029e068de5329e014e9bc5a64c"
server_key_iv: "9efa3b974c427c7f0226758c85efcee9"
server_key_version: "encryptionkey@0"
I20260806 11:46:29.223308 27654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "28252252316d465c8d1ec28a504c17e0"
format_stamp: "Formatted at 2026-08-06 11:46:29 on dist-test-slave-7z32"
server_key: "73cf54029e068de5329e014e9bc5a64c"
server_key_iv: "9efa3b974c427c7f0226758c85efcee9"
server_key_version: "encryptionkey@0"
I20260806 11:46:29.229027 27654 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260806 11:46:29.233295 27678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:29.235610 27654 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:46:29.235878 27654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "28252252316d465c8d1ec28a504c17e0"
format_stamp: "Formatted at 2026-08-06 11:46:29 on dist-test-slave-7z32"
server_key: "73cf54029e068de5329e014e9bc5a64c"
server_key_iv: "9efa3b974c427c7f0226758c85efcee9"
server_key_version: "encryptionkey@0"
I20260806 11:46:29.236075 27654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:29.256479 27654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:29.260713 27654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:29.260923 27654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:29.261754 27654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:29.262887 27654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:29.262975 27654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:29.263051 27654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:29.263103 27654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:29.279234 27654 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:44929
I20260806 11:46:29.279395 27829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:44929 every 8 connection(s)
I20260806 11:46:29.280681 27654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:46:29.290735 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 27654
I20260806 11:46:29.290942 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:46:29.291293 27315 external_mini_cluster.cc:1428] Setting key 59e57e28b42ca7cf18b42b64b1ef8c66
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[27323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016789, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:29.305773 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:29.284360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:37297 (local address 127.26.172.254:40457)
0806 11:46:29.284555 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:29.284562 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:29.286887 (+ 2325us) server_negotiation.cc:407] Connection header received
0806 11:46:29.288296 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:29.288300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:29.288379 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:29.288518 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:29.290795 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.291673 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.294297 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.294567 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.294736 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:29.299281 (+ 4545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:29.299287 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:29.299289 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:29.299333 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:29.301181 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:29.302580 (+ 1399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:29.302585 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:29.302586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:29.302724 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:29.303516 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:29.303520 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:29.303522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:29.303826 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:29.303976 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:29.305359 (+ 1383us) server_negotiation.cc:299] Negotiation successful
0806 11:46:29.305607 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 11:46:29.307976 27833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:29.285015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40457 (local address 127.26.172.194:37297)
0806 11:46:29.286479 (+ 1464us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:29.286612 (+ 133us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:29.287927 (+ 1315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:29.288922 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:29.288934 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:29.289686 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:29.290520 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:29.290546 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.292053 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.292060 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:29.294099 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:29.294125 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.294807 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.294814 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:29.295106 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:29.296222 (+ 1116us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:29.296266 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:29.298818 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:29.301449 (+ 2631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:29.301466 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:29.301500 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:29.302248 (+ 748us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:29.302914 (+ 666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:29.302921 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:29.302927 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:29.303269 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:29.304005 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:29.304019 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:29.304631 (+ 612us) client_negotiation.cc:769] Sending connection context
0806 11:46:29.305238 (+ 607us) client_negotiation.cc:240] Negotiation successful
0806 11:46:29.305904 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1066,"thread_start_us":741,"threads_started":1}
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:46:29.310135 27830 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40457
I20260806 11:46:29.310597 27830 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:29.311509 27830 heartbeater.cc:511] Master 127.26.172.254:40457 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:46:29.313803 27383 ts_manager.cc:194] Registered new tserver with Master: 28252252316d465c8d1ec28a504c17e0 (127.26.172.194:44929)
I20260806 11:46:29.314666 27383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:37297
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:46:29.345676 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40457
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:42675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:29.518134 27836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:29.518661 27836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:29.518770 27836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:29.525126 27836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:29.525295 27836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:29.525424 27836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:46:29.533093 27836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:42675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40457
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:29.534955 27836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:29.536621 27836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:29.550880 27843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:29.551205 27836 server_base.cc:1034] running on GCE node
W20260806 11:46:29.550900 27842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:29.550828 27845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:29.552090 27836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:29.553020 27836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:29.554245 27836 hybrid_clock.cc:648] HybridClock initialized: now 1786016789554224 us; error 58 us; skew 500 ppm
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[27323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016789, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:29.558198 27836 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:46:29.559544 27836 webserver.cc:460] Webserver started at http://127.26.172.195:34777/ using document root <none> and password file <none>
I20260806 11:46:29.560341 27836 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:29.560457 27836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:29.560753 27836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:29.563575 27836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "d97a1f8d87364af68b63f304900c8cfd"
format_stamp: "Formatted at 2026-08-06 11:46:29 on dist-test-slave-7z32"
server_key: "17e6f09974d451ef3e87474b956a6760"
server_key_iv: "627248f1d95389748ec33e361dd6279d"
server_key_version: "encryptionkey@0"
I20260806 11:46:29.564320 27836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "d97a1f8d87364af68b63f304900c8cfd"
format_stamp: "Formatted at 2026-08-06 11:46:29 on dist-test-slave-7z32"
server_key: "17e6f09974d451ef3e87474b956a6760"
server_key_iv: "627248f1d95389748ec33e361dd6279d"
server_key_version: "encryptionkey@0"
I20260806 11:46:29.569700 27836 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:46:29.573256 27856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:29.575245 27836 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:46:29.575515 27836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "d97a1f8d87364af68b63f304900c8cfd"
format_stamp: "Formatted at 2026-08-06 11:46:29 on dist-test-slave-7z32"
server_key: "17e6f09974d451ef3e87474b956a6760"
server_key_iv: "627248f1d95389748ec33e361dd6279d"
server_key_version: "encryptionkey@0"
I20260806 11:46:29.575680 27836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:29.596338 27836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:29.600939 27836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:29.601260 27836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:29.602160 27836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:29.603314 27836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:29.603375 27836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:29.603422 27836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:29.603510 27836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:29.623087 27836 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:35451
I20260806 11:46:29.623100 28010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:35451 every 8 connection(s)
I20260806 11:46:29.624536 27836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:46:29.630702 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 27836
I20260806 11:46:29.630975 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:46:29.631620 27315 external_mini_cluster.cc:1428] Setting key 3dccdab35efe7bc514ad6d61bf404d4a
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[27323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016789, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:29.648896 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:29.628085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:36849 (local address 127.26.172.254:40457)
0806 11:46:29.628310 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:29.628314 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:29.630399 (+ 2085us) server_negotiation.cc:407] Connection header received
0806 11:46:29.632617 (+ 2218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:29.632624 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:29.632727 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:29.632889 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:29.634940 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.635865 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.637526 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.637793 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.637941 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:29.641930 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:29.641945 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:29.641951 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:29.642012 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:29.644541 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:29.645629 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:29.645633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:29.645634 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:29.645741 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:29.646444 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:29.646447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:29.646448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:29.646728 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:29.646892 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:29.648462 (+ 1570us) server_negotiation.cc:299] Negotiation successful
0806 11:46:29.648686 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260806 11:46:29.650279 28013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:29.629075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40457 (local address 127.26.172.195:36849)
0806 11:46:29.630051 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:29.630128 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:29.632129 (+ 2001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:29.633237 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:29.633247 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:29.633849 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:29.634628 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:29.634652 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.636086 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.636090 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:29.637246 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:29.637259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.638009 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.638013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:29.638183 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:29.639146 (+ 963us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:29.639168 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:29.641465 (+ 2297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:29.644813 (+ 3348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:29.644827 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:29.644854 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:29.645432 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:29.645908 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:29.645912 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:29.645914 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:29.646275 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:29.646953 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:29.646963 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:29.647831 (+ 868us) client_negotiation.cc:769] Sending connection context
0806 11:46:29.648401 (+ 570us) client_negotiation.cc:240] Negotiation successful
0806 11:46:29.649030 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":262,"threads_started":1}
I20260806 11:46:29.652278 28011 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40457
I20260806 11:46:29.652781 28011 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:29.653604 28011 heartbeater.cc:511] Master 127.26.172.254:40457 requested a full tablet report, sending...
I20260806 11:46:29.655803 27383 ts_manager.cc:194] Registered new tserver with Master: d97a1f8d87364af68b63f304900c8cfd (127.26.172.195:35451)
I20260806 11:46:29.656574 27383 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:36849
I20260806 11:46:29.662210 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[27323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016789, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[27323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016789, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:46:29.706488 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:29.691610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59556 (local address 127.26.172.193:44723)
0806 11:46:29.692251 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:29.692269 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:29.692307 (+ 38us) server_negotiation.cc:407] Connection header received
0806 11:46:29.692377 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:29.692383 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:29.692818 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:29.693171 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:29.694278 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.695423 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.696628 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.697143 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.697284 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:29.700828 (+ 3544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:29.700864 (+ 36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:29.700889 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:29.700933 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:29.703483 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:29.704321 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:29.704329 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:29.704330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:29.704525 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:29.705090 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:29.705094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:29.705095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:29.705509 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:29.705739 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:29.706137 (+ 398us) server_negotiation.cc:299] Negotiation successful
0806 11:46:29.706321 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":194,"threads_started":1}
W20260806 11:46:29.708326 27532 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59556
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[27323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[27323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016789, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:46:29.749500 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:29.736926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59566 (local address 127.26.172.193:44723)
0806 11:46:29.737177 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:29.737182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:29.737207 (+ 25us) server_negotiation.cc:407] Connection header received
0806 11:46:29.737429 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:29.737432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:29.737491 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:29.737591 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:29.738680 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.739344 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.740545 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:29.740843 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:29.741130 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:29.744917 (+ 3787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:29.744922 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:29.744925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:29.744965 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:29.747152 (+ 2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:29.747861 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:29.747865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:29.747866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:29.747986 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:29.748349 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:29.748354 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:29.748356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:29.748597 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:29.748730 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:29.749098 (+ 368us) server_negotiation.cc:299] Negotiation successful
0806 11:46:29.749243 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260806 11:46:29.751688 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 27467
I20260806 11:46:29.771396 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 27654
I20260806 11:46:29.814808 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 27836
I20260806 11:46:29.836867 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 27339
2026-08-06T11:46:29Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3290 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[28031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[28031](info): set up 2 sockets
Aug 06 11:46:29 dist-test-slave-7z32 krb5kdc[28031](info): commencing operation
krb5kdc: starting...
W20260806 11:46:31.209419 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:46:31 dist-test-slave-7z32 krb5kdc[28031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:46:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:46:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:46:31.413043 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:41873
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:41873
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:31.555464 28055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:31.555876 28055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:31.555971 28055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:31.560343 28055 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:46:31.560478 28055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:31.560513 28055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:31.560555 28055 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:46:31.560592 28055 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:46:31.566655 28055 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:41873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:41873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:31.568104 28055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:31.569383 28055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:31.581480 28067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:31.581480 28063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:31.581508 28062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:31.581904 28055 server_base.cc:1034] running on GCE node
I20260806 11:46:31.582948 28055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:31.584780 28055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:31.586130 28055 hybrid_clock.cc:648] HybridClock initialized: now 1786016791586085 us; error 62 us; skew 500 ppm
Aug 06 11:46:31 dist-test-slave-7z32 krb5kdc[28031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016791, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:31.591216 28055 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:46:31.592912 28055 webserver.cc:460] Webserver started at http://127.26.172.254:35037/ using document root <none> and password file <none>
I20260806 11:46:31.593822 28055 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:31.593918 28055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:31.594231 28055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:31.597918 28055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "74b241e243fb4128a6b76b6f67f228d1"
format_stamp: "Formatted at 2026-08-06 11:46:31 on dist-test-slave-7z32"
server_key: "8a1725b36e366fe529fd6ad9540dd8c3"
server_key_iv: "10ddfe06fa4e917dedc4db88fa5b4082"
server_key_version: "encryptionkey@0"
I20260806 11:46:31.599102 28055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "74b241e243fb4128a6b76b6f67f228d1"
format_stamp: "Formatted at 2026-08-06 11:46:31 on dist-test-slave-7z32"
server_key: "8a1725b36e366fe529fd6ad9540dd8c3"
server_key_iv: "10ddfe06fa4e917dedc4db88fa5b4082"
server_key_version: "encryptionkey@0"
I20260806 11:46:31.605417 28055 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 11:46:31.609754 28075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:31.612169 28055 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:46:31.612445 28055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "74b241e243fb4128a6b76b6f67f228d1"
format_stamp: "Formatted at 2026-08-06 11:46:31 on dist-test-slave-7z32"
server_key: "8a1725b36e366fe529fd6ad9540dd8c3"
server_key_iv: "10ddfe06fa4e917dedc4db88fa5b4082"
server_key_version: "encryptionkey@0"
I20260806 11:46:31.612730 28055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:31.657291 28055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:31.663409 28055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:31.663915 28055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:31.675643 28055 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:41873
I20260806 11:46:31.675766 28140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:41873 every 8 connection(s)
I20260806 11:46:31.677174 28055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:46:31.681200 28141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:31.686141 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 28055
I20260806 11:46:31.686308 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:46:31.686632 27315 external_mini_cluster.cc:1428] Setting key a03d0f99441c45cf03d740f37e27f2e9
I20260806 11:46:31.689284 28141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1: Bootstrap starting.
I20260806 11:46:31.692303 28141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:31.693305 28141 log.cc:824] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:31.695989 28141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1: No bootstrap required, opened a new log
Aug 06 11:46:31 dist-test-slave-7z32 krb5kdc[28031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:31.701735 28141 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74b241e243fb4128a6b76b6f67f228d1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41873 } }
I20260806 11:46:31.702194 28141 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:31.702275 28141 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b241e243fb4128a6b76b6f67f228d1, State: Initialized, Role: FOLLOWER
I20260806 11:46:31.703023 28141 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74b241e243fb4128a6b76b6f67f228d1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41873 } }
I20260806 11:46:31.703200 28141 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:46:31.703256 28141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:46:31.703341 28141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:31.704909 28141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74b241e243fb4128a6b76b6f67f228d1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41873 } }
I20260806 11:46:31.705413 28141 leader_election.cc:302] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74b241e243fb4128a6b76b6f67f228d1; no voters:
I20260806 11:46:31.705868 28141 leader_election.cc:288] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:46:31.705955 28149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:31.706267 28149 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [term 1 LEADER]: Becoming Leader. State: Replica: 74b241e243fb4128a6b76b6f67f228d1, State: Running, Role: LEADER
I20260806 11:46:31.706667 28149 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74b241e243fb4128a6b76b6f67f228d1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41873 } }
I20260806 11:46:31.707669 28141 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:46:31.708850 28152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74b241e243fb4128a6b76b6f67f228d1. Latest consensus state: current_term: 1 leader_uuid: "74b241e243fb4128a6b76b6f67f228d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74b241e243fb4128a6b76b6f67f228d1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41873 } } }
I20260806 11:46:31.709594 28152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:31.709398 28151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74b241e243fb4128a6b76b6f67f228d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74b241e243fb4128a6b76b6f67f228d1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41873 } } }
I20260806 11:46:31.710197 28151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:31.712661 28145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:31.689017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43612 (local address 127.26.172.254:41873)
0806 11:46:31.689796 (+ 779us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:31.689818 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:31.689962 (+ 144us) server_negotiation.cc:407] Connection header received
0806 11:46:31.691229 (+ 1267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:31.691261 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:31.691816 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:31.692330 (+ 514us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:31.693422 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:31.694701 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:31.695823 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:31.696805 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:31.697058 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:31.701525 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:31.701535 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:31.701564 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:31.701626 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:31.705800 (+ 4174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:31.706976 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:31.706985 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:31.706996 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:31.707238 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:31.707677 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:31.707682 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:31.707684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:31.708632 (+ 948us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:31.708936 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:31.710930 (+ 1994us) server_negotiation.cc:299] Negotiation successful
0806 11:46:31.711496 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":213,"threads_started":1}
W20260806 11:46:31.714653 28167 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:46:31.714855 28167 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:46:31.714955 28166 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:46:31.715816 28166 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:46:31.725521 28166 catalog_manager.cc:1347] Generated new cluster ID: db0eeb6ad1684112aa5e0f40aa0f9079
I20260806 11:46:31.725709 28166 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:46:31.735756 28166 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:46:31.737445 28166 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:46:31.749565 28166 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74b241e243fb4128a6b76b6f67f228d1: Generated new TSK 0
I20260806 11:46:31.750703 28166 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:46:31.800609 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41873
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:31.961158 28174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:31.961670 28174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:31.961774 28174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:31.966881 28174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:31.967043 28174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:31.967166 28174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:46:31.974038 28174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41873
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:31.975898 28174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:31.977504 28174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:31.991238 28180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:31.991269 28183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:31.991750 28174 server_base.cc:1034] running on GCE node
W20260806 11:46:31.991276 28181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:31.992514 28174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:31.993539 28174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:31.994766 28174 hybrid_clock.cc:648] HybridClock initialized: now 1786016791994727 us; error 67 us; skew 500 ppm
Aug 06 11:46:31 dist-test-slave-7z32 krb5kdc[28031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016791, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:31.999287 28174 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:46:32.001181 28174 webserver.cc:460] Webserver started at http://127.26.172.193:39993/ using document root <none> and password file <none>
I20260806 11:46:32.002213 28174 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:32.002398 28174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:32.002772 28174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:32.006100 28174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "94374b3a12bb4002a7f6c37da084047c"
format_stamp: "Formatted at 2026-08-06 11:46:31 on dist-test-slave-7z32"
server_key: "a2f880803386ea6dd98ebb2c38d95d7b"
server_key_iv: "0f1e0536e4640638bc56878019705997"
server_key_version: "encryptionkey@0"
I20260806 11:46:32.007082 28174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "94374b3a12bb4002a7f6c37da084047c"
format_stamp: "Formatted at 2026-08-06 11:46:31 on dist-test-slave-7z32"
server_key: "a2f880803386ea6dd98ebb2c38d95d7b"
server_key_iv: "0f1e0536e4640638bc56878019705997"
server_key_version: "encryptionkey@0"
I20260806 11:46:32.013784 28174 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 11:46:32.018100 28196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:32.020763 28174 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:46:32.021041 28174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "94374b3a12bb4002a7f6c37da084047c"
format_stamp: "Formatted at 2026-08-06 11:46:31 on dist-test-slave-7z32"
server_key: "a2f880803386ea6dd98ebb2c38d95d7b"
server_key_iv: "0f1e0536e4640638bc56878019705997"
server_key_version: "encryptionkey@0"
I20260806 11:46:32.021369 28174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:32.039377 28174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:32.044603 28174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:32.045065 28174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:32.046069 28174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:32.047470 28174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:32.047566 28174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:32.047668 28174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:32.047724 28174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:32.063076 28174 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:45307
I20260806 11:46:32.063150 28350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:45307 every 8 connection(s)
I20260806 11:46:32.064667 28174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:46:32.073720 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 28174
I20260806 11:46:32.073910 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:46:32.074196 27315 external_mini_cluster.cc:1428] Setting key 88d2aaaa19acc047f3a4910612f37751
Aug 06 11:46:32 dist-test-slave-7z32 krb5kdc[28031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016791, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:32.089813 28145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.067866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:38305 (local address 127.26.172.254:41873)
0806 11:46:32.068118 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.068123 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.069613 (+ 1490us) server_negotiation.cc:407] Connection header received
0806 11:46:32.071584 (+ 1971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.071589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.071684 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.071827 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:32.073650 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.074348 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.077147 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.077535 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.077651 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.082712 (+ 5061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:32.082719 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:32.082725 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:32.082786 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:32.085420 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.086800 (+ 1380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.086808 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.086811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.086998 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.087670 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.087676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.087678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.088038 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:32.088186 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.089339 (+ 1153us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.089563 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:46:32.091246 28356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.068438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41873 (local address 127.26.172.193:38305)
0806 11:46:32.069273 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:32.069427 (+ 154us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:32.071177 (+ 1750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:32.072142 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:32.072152 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:32.072688 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:32.073371 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.073389 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.074645 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.074652 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.076864 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.076888 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.077849 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.077855 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.078184 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.079243 (+ 1059us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:32.079280 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:32.082339 (+ 3059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:32.085770 (+ 3431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:32.085786 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:32.085819 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:32.086593 (+ 774us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:32.087186 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:32.087190 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:32.087192 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:32.087469 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:32.088258 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:32.088267 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:32.088899 (+ 632us) client_negotiation.cc:769] Sending connection context
0806 11:46:32.089171 (+ 272us) client_negotiation.cc:240] Negotiation successful
0806 11:46:32.089612 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":186,"threads_started":1}
I20260806 11:46:32.093516 28352 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41873
I20260806 11:46:32.093940 28352 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:32.094763 28352 heartbeater.cc:511] Master 127.26.172.254:41873 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:46:32.097319 28098 ts_manager.cc:194] Registered new tserver with Master: 94374b3a12bb4002a7f6c37da084047c (127.26.172.193:45307)
I20260806 11:46:32.098785 28098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:38305
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:46:32.125016 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41873
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:32.268735 28359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:32.269245 28359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:32.269322 28359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:32.274134 28359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:32.274255 28359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:32.274324 28359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:46:32.280620 28359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41873
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:32.282012 28359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:32.283324 28359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:32.296446 28367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:32.296643 28370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:32.296429 28368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:32.297134 28359 server_base.cc:1034] running on GCE node
I20260806 11:46:32.297933 28359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:32.299232 28359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:32.300614 28359 hybrid_clock.cc:648] HybridClock initialized: now 1786016792300516 us; error 119 us; skew 500 ppm
Aug 06 11:46:32 dist-test-slave-7z32 krb5kdc[28031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016792, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:32.305269 28359 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:46:32.307181 28359 webserver.cc:460] Webserver started at http://127.26.172.194:33819/ using document root <none> and password file <none>
I20260806 11:46:32.308422 28359 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:32.308552 28359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:32.308911 28359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:32.312253 28359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "d90874d3f0924974a869966b7468b378"
format_stamp: "Formatted at 2026-08-06 11:46:32 on dist-test-slave-7z32"
server_key: "5d9521f3a04de72da40f81e3b64484f9"
server_key_iv: "746bf3c130805255d153c68a77698042"
server_key_version: "encryptionkey@0"
I20260806 11:46:32.313028 28359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "d90874d3f0924974a869966b7468b378"
format_stamp: "Formatted at 2026-08-06 11:46:32 on dist-test-slave-7z32"
server_key: "5d9521f3a04de72da40f81e3b64484f9"
server_key_iv: "746bf3c130805255d153c68a77698042"
server_key_version: "encryptionkey@0"
I20260806 11:46:32.319232 28359 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 11:46:32.323325 28378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:32.325600 28359 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:46:32.325814 28359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "d90874d3f0924974a869966b7468b378"
format_stamp: "Formatted at 2026-08-06 11:46:32 on dist-test-slave-7z32"
server_key: "5d9521f3a04de72da40f81e3b64484f9"
server_key_iv: "746bf3c130805255d153c68a77698042"
server_key_version: "encryptionkey@0"
I20260806 11:46:32.325974 28359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:32.340521 28359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:32.345422 28359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:32.345683 28359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:32.346521 28359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:32.347846 28359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:32.347905 28359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:32.347958 28359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:32.348030 28359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:32.362540 28359 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:37203
I20260806 11:46:32.362659 28541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:37203 every 8 connection(s)
I20260806 11:46:32.364042 28359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:46:32.367690 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 28359
I20260806 11:46:32.367823 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:46:32.368148 27315 external_mini_cluster.cc:1428] Setting key 77bf0bd98a67cd078e25abc99c6eaed3
Aug 06 11:46:32 dist-test-slave-7z32 krb5kdc[28031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016792, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:46:32.383973 28145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.366999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:44047 (local address 127.26.172.254:41873)
0806 11:46:32.367178 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.367182 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.368737 (+ 1555us) server_negotiation.cc:407] Connection header received
0806 11:46:32.370369 (+ 1632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.370372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.370440 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.370544 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:32.372811 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.373675 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.375362 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.375616 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.375744 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.379134 (+ 3390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:32.379138 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:32.379140 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:32.379171 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:32.381145 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.382030 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.382034 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.382041 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.382132 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.382543 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.382546 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.382548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.382775 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:32.382947 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.383576 (+ 629us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.383730 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 11:46:32.384996 28544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.367480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41873 (local address 127.26.172.194:44047)
0806 11:46:32.368425 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:32.368527 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:32.370102 (+ 1575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:32.370860 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:32.370876 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:32.371595 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:32.372563 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.372592 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.373905 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.373911 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.375191 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.375210 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.375816 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.375821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.376024 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.376881 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:32.376901 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:32.378791 (+ 1890us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:32.381429 (+ 2638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:32.381438 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:32.381463 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:32.381888 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:32.382243 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:32.382246 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:32.382248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:32.382426 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:32.382947 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:32.382956 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:32.383288 (+ 332us) client_negotiation.cc:769] Sending connection context
0806 11:46:32.383513 (+ 225us) client_negotiation.cc:240] Negotiation successful
0806 11:46:32.383954 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":328,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:46:32.386550 28542 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41873
I20260806 11:46:32.386957 28542 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:32.387598 28542 heartbeater.cc:511] Master 127.26.172.254:41873 requested a full tablet report, sending...
I20260806 11:46:32.388917 28098 ts_manager.cc:194] Registered new tserver with Master: d90874d3f0924974a869966b7468b378 (127.26.172.194:37203)
I20260806 11:46:32.389838 28098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:44047
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:46:32.413501 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41873
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:32.547344 28548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:32.547724 28548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:32.547811 28548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:32.552261 28548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:32.552386 28548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:32.552491 28548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:46:32.558458 28548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41873
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:32.559774 28548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:32.560935 28548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:32.572763 28556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:32.572813 28558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:32.572772 28554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:32.573382 28548 server_base.cc:1034] running on GCE node
I20260806 11:46:32.573959 28548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:32.575217 28548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:32.576449 28548 hybrid_clock.cc:648] HybridClock initialized: now 1786016792576391 us; error 89 us; skew 500 ppm
Aug 06 11:46:32 dist-test-slave-7z32 krb5kdc[28031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016792, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:32.581176 28548 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:46:32.582732 28548 webserver.cc:460] Webserver started at http://127.26.172.195:45827/ using document root <none> and password file <none>
I20260806 11:46:32.584628 28548 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:32.584946 28548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:32.585305 28548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:32.588709 28548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "11f006ff6afa4022a721f7e8b7e9cf02"
format_stamp: "Formatted at 2026-08-06 11:46:32 on dist-test-slave-7z32"
server_key: "1af5d30f9b3720de339cd0f5f1fa4322"
server_key_iv: "1ff4ee35d7be48b878ff0ef7a129a0d3"
server_key_version: "encryptionkey@0"
I20260806 11:46:32.589636 28548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "11f006ff6afa4022a721f7e8b7e9cf02"
format_stamp: "Formatted at 2026-08-06 11:46:32 on dist-test-slave-7z32"
server_key: "1af5d30f9b3720de339cd0f5f1fa4322"
server_key_iv: "1ff4ee35d7be48b878ff0ef7a129a0d3"
server_key_version: "encryptionkey@0"
I20260806 11:46:32.596236 28548 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260806 11:46:32.600623 28574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:32.603075 28548 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260806 11:46:32.603369 28548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "11f006ff6afa4022a721f7e8b7e9cf02"
format_stamp: "Formatted at 2026-08-06 11:46:32 on dist-test-slave-7z32"
server_key: "1af5d30f9b3720de339cd0f5f1fa4322"
server_key_iv: "1ff4ee35d7be48b878ff0ef7a129a0d3"
server_key_version: "encryptionkey@0"
I20260806 11:46:32.603575 28548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:32.619712 28548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:32.625228 28548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:32.625540 28548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:32.626459 28548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:32.627899 28548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:32.627985 28548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:32.628072 28548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:32.628130 28548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:32.643574 28548 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:33129
I20260806 11:46:32.643597 28751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:33129 every 8 connection(s)
I20260806 11:46:32.645356 28548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:46:32.647571 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 28548
I20260806 11:46:32.647830 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:46:32.648263 27315 external_mini_cluster.cc:1428] Setting key 30dff925b11d0af419b6fadfdbd06908
Aug 06 11:46:32 dist-test-slave-7z32 krb5kdc[28031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016792, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:32.664781 28145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.648444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:56689 (local address 127.26.172.254:41873)
0806 11:46:32.648679 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.648687 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.649912 (+ 1225us) server_negotiation.cc:407] Connection header received
0806 11:46:32.651245 (+ 1333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.651250 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.651326 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.651456 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:32.652882 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.653452 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.654775 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.655102 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.655224 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.658773 (+ 3549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:32.658778 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:32.658780 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:32.658813 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:32.661519 (+ 2706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.662602 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.662613 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.662615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.662744 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.663265 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.663270 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.663272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.663537 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:32.663668 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.664373 (+ 705us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.664572 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 11:46:32.665859 28756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.648938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41873 (local address 127.26.172.195:56689)
0806 11:46:32.649666 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:32.649745 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:32.650957 (+ 1212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:32.651678 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:32.651686 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:32.652124 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:32.652703 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.652717 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.653619 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.653622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.654612 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.654624 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.655304 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.655309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.655496 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.656240 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:32.656260 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:32.658446 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:32.661810 (+ 3364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:32.661820 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:32.661899 (+ 79us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:32.662397 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:32.662923 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:32.662927 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:32.662929 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:32.663132 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:32.663685 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:32.663696 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:32.664040 (+ 344us) client_negotiation.cc:769] Sending connection context
0806 11:46:32.664287 (+ 247us) client_negotiation.cc:240] Negotiation successful
0806 11:46:32.664727 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":194,"threads_started":1}
I20260806 11:46:32.668149 28753 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41873
I20260806 11:46:32.668522 28753 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:32.669269 28753 heartbeater.cc:511] Master 127.26.172.254:41873 requested a full tablet report, sending...
I20260806 11:46:32.670990 28098 ts_manager.cc:194] Registered new tserver with Master: 11f006ff6afa4022a721f7e8b7e9cf02 (127.26.172.195:33129)
I20260806 11:46:32.671868 28098 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:56689
I20260806 11:46:32.677484 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:46:32.696435 28145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.682708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43622 (local address 127.26.172.254:41873)
0806 11:46:32.682962 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.682970 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.683314 (+ 344us) server_negotiation.cc:407] Connection header received
0806 11:46:32.683534 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.683538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.683649 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.683768 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:32.684954 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.685584 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.687323 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.687684 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.687831 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.690468 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:32.690473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:32.690477 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:32.690723 (+ 246us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:32.693270 (+ 2547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.694144 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.694149 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.694151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.694441 (+ 290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.694940 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.694944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.694945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.695322 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:32.695464 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.695915 (+ 451us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.696163 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 11:46:32.704792 28098 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:46:32.709667 28098 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:32.731082 28773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.724130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38678 (local address 127.26.172.194:37203)
0806 11:46:32.725090 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.725105 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.725131 (+ 26us) server_negotiation.cc:407] Connection header received
0806 11:46:32.725232 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.725238 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.725430 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.725615 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:32.726163 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.727227 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.729299 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.730272 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.730416 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.730592 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.730749 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.730893 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":828,"thread_start_us":158,"threads_started":1}
I20260806 11:46:32.731582 28766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.723928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37203 (local address 127.0.0.1:38678)
0806 11:46:32.724429 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:32.724505 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:32.724698 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:32.725647 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:32.725654 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:32.725687 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:32.725989 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.725997 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.727378 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.727384 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.729114 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.729135 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.730414 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.730418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.730535 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.730578 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 11:46:32.730703 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 11:46:32.731405 (+ 702us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":249,"thread_start_us":127,"threads_started":1}
I20260806 11:46:32.731904 28769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.723498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56948 (local address 127.26.172.195:33129)
0806 11:46:32.724016 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.724032 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.724635 (+ 603us) server_negotiation.cc:407] Connection header received
0806 11:46:32.724932 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.724942 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.725230 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.725388 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:32.726183 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.727559 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.729486 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.730516 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.730702 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.731006 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.731499 (+ 493us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.731675 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":150,"threads_started":1}
I20260806 11:46:32.732163 28774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.724407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:45307 (local address 127.0.0.1:57932)
0806 11:46:32.725951 (+ 1544us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:32.725970 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:32.726076 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:32.726963 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:32.726966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:32.726989 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:32.727111 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.727117 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.728699 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.728702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.730064 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.730078 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.731693 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.731697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.731806 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.731832 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 11:46:32.731885 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 11:46:32.732004 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1451,"mutex_wait_us":70,"thread_start_us":91,"threads_started":1}
I20260806 11:46:32.732451 28772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.723311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:33129 (local address 127.0.0.1:56948)
0806 11:46:32.724429 (+ 1118us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:32.724505 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:32.724706 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:32.725681 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:32.725685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:32.725707 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:32.726005 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.726019 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.727825 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.727829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.729323 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.729337 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.731155 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.731160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.731266 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.731298 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 11:46:32.732230 (+ 932us) client_negotiation.cc:240] Negotiation successful
0806 11:46:32.732335 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":881,"mutex_wait_us":184,"thread_start_us":148,"threads_started":1}
I20260806 11:46:32.732975 28775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.724698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57932 (local address 127.26.172.193:45307)
0806 11:46:32.726419 (+ 1721us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.726427 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.726457 (+ 30us) server_negotiation.cc:407] Connection header received
0806 11:46:32.726550 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.726557 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.726764 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.726960 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:32.727277 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.728551 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.730339 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.731522 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.732399 (+ 877us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.732594 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.732682 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.732811 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1573,"thread_start_us":164,"threads_started":1}
I20260806 11:46:32.735539 28443 tablet_service.cc:1467] Processing CreateTablet for tablet 1e7013090db64f01971b78791e71ebd2 (DEFAULT_TABLE table=test-table [id=07e6981fa5524b5a80fc95e435fcf0c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:32.736716 28443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e7013090db64f01971b78791e71ebd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:32.736940 28259 tablet_service.cc:1467] Processing CreateTablet for tablet 1e7013090db64f01971b78791e71ebd2 (DEFAULT_TABLE table=test-table [id=07e6981fa5524b5a80fc95e435fcf0c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:32.736938 28654 tablet_service.cc:1467] Processing CreateTablet for tablet 1e7013090db64f01971b78791e71ebd2 (DEFAULT_TABLE table=test-table [id=07e6981fa5524b5a80fc95e435fcf0c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:32.738574 28654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e7013090db64f01971b78791e71ebd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:32.738569 28259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e7013090db64f01971b78791e71ebd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:32.744830 28776 tablet_bootstrap.cc:492] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378: Bootstrap starting.
I20260806 11:46:32.747864 28776 tablet_bootstrap.cc:654] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:32.748992 28776 log.cc:824] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:32.749843 28778 tablet_bootstrap.cc:492] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c: Bootstrap starting.
I20260806 11:46:32.750002 28779 tablet_bootstrap.cc:492] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02: Bootstrap starting.
I20260806 11:46:32.752615 28778 tablet_bootstrap.cc:654] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:32.753419 28776 tablet_bootstrap.cc:492] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378: No bootstrap required, opened a new log
I20260806 11:46:32.753751 28779 tablet_bootstrap.cc:654] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:32.753775 28776 ts_tablet_manager.cc:1397] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260806 11:46:32.753773 28778 log.cc:824] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:32.755548 28779 log.cc:824] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:32.756959 28778 tablet_bootstrap.cc:492] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c: No bootstrap required, opened a new log
I20260806 11:46:32.757248 28778 ts_tablet_manager.cc:1397] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 11:46:32.758888 28779 tablet_bootstrap.cc:492] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02: No bootstrap required, opened a new log
I20260806 11:46:32.759259 28779 ts_tablet_manager.cc:1397] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260806 11:46:32.759383 28776 raft_consensus.cc:348] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33129 } } peers { permanent_uuid: "d90874d3f0924974a869966b7468b378" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37203 } } peers { permanent_uuid: "94374b3a12bb4002a7f6c37da084047c" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45307 } }
I20260806 11:46:32.759833 28776 raft_consensus.cc:374] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:32.759907 28776 raft_consensus.cc:729] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d90874d3f0924974a869966b7468b378, State: Initialized, Role: FOLLOWER
I20260806 11:46:32.760658 28776 consensus_queue.cc:260] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33129 } } peers { permanent_uuid: "d90874d3f0924974a869966b7468b378" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37203 } } peers { permanent_uuid: "94374b3a12bb4002a7f6c37da084047c" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45307 } }
I20260806 11:46:32.761813 28542 heartbeater.cc:503] Master 127.26.172.254:41873 was elected leader, sending a full tablet report...
I20260806 11:46:32.762234 28778 raft_consensus.cc:348] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33129 } } peers { permanent_uuid: "d90874d3f0924974a869966b7468b378" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37203 } } peers { permanent_uuid: "94374b3a12bb4002a7f6c37da084047c" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45307 } }
I20260806 11:46:32.762575 28778 raft_consensus.cc:374] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:32.762640 28778 raft_consensus.cc:729] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94374b3a12bb4002a7f6c37da084047c, State: Initialized, Role: FOLLOWER
I20260806 11:46:32.763396 28776 ts_tablet_manager.cc:1428] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260806 11:46:32.763319 28778 consensus_queue.cc:260] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33129 } } peers { permanent_uuid: "d90874d3f0924974a869966b7468b378" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37203 } } peers { permanent_uuid: "94374b3a12bb4002a7f6c37da084047c" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45307 } }
I20260806 11:46:32.764460 28778 ts_tablet_manager.cc:1428] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260806 11:46:32.764902 28352 heartbeater.cc:503] Master 127.26.172.254:41873 was elected leader, sending a full tablet report...
I20260806 11:46:32.764809 28779 raft_consensus.cc:348] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33129 } } peers { permanent_uuid: "d90874d3f0924974a869966b7468b378" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37203 } } peers { permanent_uuid: "94374b3a12bb4002a7f6c37da084047c" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45307 } }
I20260806 11:46:32.765231 28779 raft_consensus.cc:374] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:32.765322 28779 raft_consensus.cc:729] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11f006ff6afa4022a721f7e8b7e9cf02, State: Initialized, Role: FOLLOWER
I20260806 11:46:32.765967 28779 consensus_queue.cc:260] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33129 } } peers { permanent_uuid: "d90874d3f0924974a869966b7468b378" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37203 } } peers { permanent_uuid: "94374b3a12bb4002a7f6c37da084047c" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45307 } }
I20260806 11:46:32.767071 28753 heartbeater.cc:503] Master 127.26.172.254:41873 was elected leader, sending a full tablet report...
I20260806 11:46:32.767593 28779 ts_tablet_manager.cc:1428] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260806 11:46:32.803109 28783 raft_consensus.cc:482] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:32.803503 28783 raft_consensus.cc:504] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33129 } } peers { permanent_uuid: "d90874d3f0924974a869966b7468b378" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37203 } } peers { permanent_uuid: "94374b3a12bb4002a7f6c37da084047c" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45307 } }
I20260806 11:46:32.805189 28783 leader_election.cc:288] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11f006ff6afa4022a721f7e8b7e9cf02 (127.26.172.195:33129), 94374b3a12bb4002a7f6c37da084047c (127.26.172.193:45307)
I20260806 11:46:32.811501 28769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.805780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:45669 (local address 127.26.172.195:33129)
0806 11:46:32.806020 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.806027 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.806053 (+ 26us) server_negotiation.cc:407] Connection header received
0806 11:46:32.806169 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.806173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.806255 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.806351 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:32.806816 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.807755 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.810212 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.810749 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.810944 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.811013 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.811250 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.811350 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260806 11:46:32.811504 28544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.805486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:33129 (local address 127.26.172.194:45669)
0806 11:46:32.805669 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:32.805694 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:32.805836 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:32.806426 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:32.806429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:32.806483 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:32.806662 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.806668 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.807969 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.807975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.809980 (+ 2005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.809996 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.810944 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.810948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.811093 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.811117 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 11:46:32.811227 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 11:46:32.811330 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":162,"spinlock_wait_cycles":44288}
I20260806 11:46:32.811632 28775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.805915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:47319 (local address 127.26.172.193:45307)
0806 11:46:32.806107 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.806114 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.806481 (+ 367us) server_negotiation.cc:407] Connection header received
0806 11:46:32.806630 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.806633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.806689 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.806815 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:32.807206 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.808080 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.810225 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.810783 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.810996 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.811071 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.811339 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.811438 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 11:46:32.812300 28789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.805766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:45307 (local address 127.26.172.194:47319)
0806 11:46:32.806295 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:32.806310 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:32.806491 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:32.806909 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:32.806911 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:32.806930 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:32.807043 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.807047 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.808177 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.808181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.809980 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:32.809996 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.810997 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.811003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:32.811166 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.811204 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 11:46:32.811318 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 11:46:32.811433 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":109,"spinlock_wait_cycles":5120,"thread_start_us":201,"threads_started":1}
I20260806 11:46:32.812521 28681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e7013090db64f01971b78791e71ebd2" candidate_uuid: "d90874d3f0924974a869966b7468b378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" is_pre_election: true
I20260806 11:46:32.813071 28681 raft_consensus.cc:2454] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d90874d3f0924974a869966b7468b378 in term 0.
I20260806 11:46:32.813360 28289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e7013090db64f01971b78791e71ebd2" candidate_uuid: "d90874d3f0924974a869966b7468b378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94374b3a12bb4002a7f6c37da084047c" is_pre_election: true
I20260806 11:46:32.813772 28289 raft_consensus.cc:2454] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d90874d3f0924974a869966b7468b378 in term 0.
I20260806 11:46:32.813985 28381 leader_election.cc:302] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11f006ff6afa4022a721f7e8b7e9cf02, d90874d3f0924974a869966b7468b378; no voters:
I20260806 11:46:32.814489 28783 raft_consensus.cc:2781] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:32.814612 28783 raft_consensus.cc:482] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:32.814649 28783 raft_consensus.cc:3037] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:32.816181 28783 raft_consensus.cc:504] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33129 } } peers { permanent_uuid: "d90874d3f0924974a869966b7468b378" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37203 } } peers { permanent_uuid: "94374b3a12bb4002a7f6c37da084047c" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45307 } }
I20260806 11:46:32.816692 28783 leader_election.cc:288] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [CANDIDATE]: Term 1 election: Requested vote from peers 11f006ff6afa4022a721f7e8b7e9cf02 (127.26.172.195:33129), 94374b3a12bb4002a7f6c37da084047c (127.26.172.193:45307)
W20260806 11:46:32.817010 28353 tablet.cc:2369] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:46:32.817304 28681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e7013090db64f01971b78791e71ebd2" candidate_uuid: "d90874d3f0924974a869966b7468b378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11f006ff6afa4022a721f7e8b7e9cf02"
I20260806 11:46:32.817345 28289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e7013090db64f01971b78791e71ebd2" candidate_uuid: "d90874d3f0924974a869966b7468b378" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94374b3a12bb4002a7f6c37da084047c"
I20260806 11:46:32.817539 28289 raft_consensus.cc:3037] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:32.817520 28681 raft_consensus.cc:3037] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:32.819193 28289 raft_consensus.cc:2454] T 1e7013090db64f01971b78791e71ebd2 P 94374b3a12bb4002a7f6c37da084047c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d90874d3f0924974a869966b7468b378 in term 1.
I20260806 11:46:32.819582 28681 raft_consensus.cc:2454] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d90874d3f0924974a869966b7468b378 in term 1.
I20260806 11:46:32.819832 28382 leader_election.cc:302] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94374b3a12bb4002a7f6c37da084047c, d90874d3f0924974a869966b7468b378; no voters:
I20260806 11:46:32.820188 28783 raft_consensus.cc:2781] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:32.820482 28783 raft_consensus.cc:686] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [term 1 LEADER]: Becoming Leader. State: Replica: d90874d3f0924974a869966b7468b378, State: Running, Role: LEADER
I20260806 11:46:32.820904 28783 consensus_queue.cc:237] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33129 } } peers { permanent_uuid: "d90874d3f0924974a869966b7468b378" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37203 } } peers { permanent_uuid: "94374b3a12bb4002a7f6c37da084047c" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45307 } }
I20260806 11:46:32.825807 28098 catalog_manager.cc:5495] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378 reported cstate change: term changed from 0 to 1, leader changed from <none> to d90874d3f0924974a869966b7468b378 (127.26.172.194). New cstate: current_term: 1 leader_uuid: "d90874d3f0924974a869966b7468b378" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f006ff6afa4022a721f7e8b7e9cf02" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d90874d3f0924974a869966b7468b378" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94374b3a12bb4002a7f6c37da084047c" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45307 } health_report { overall_health: UNKNOWN } } }
Aug 06 11:46:32 dist-test-slave-7z32 krb5kdc[28031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
W20260806 11:46:32.865875 28543 tablet.cc:2369] T 1e7013090db64f01971b78791e71ebd2 P d90874d3f0924974a869966b7468b378: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:46:32.870129 28775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.856864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57944 (local address 127.26.172.193:45307)
0806 11:46:32.857090 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.857094 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.857252 (+ 158us) server_negotiation.cc:407] Connection header received
0806 11:46:32.857418 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.857421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.857535 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.857634 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:32.858754 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.859362 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.860525 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.860786 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.860896 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.864226 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:32.864247 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:32.864272 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:32.864319 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:32.867061 (+ 2742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.867879 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.867886 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.867888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.868021 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.868603 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.868606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.868608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.868988 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:32.869198 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.869621 (+ 423us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.869864 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
Aug 06 11:46:32 dist-test-slave-7z32 krb5kdc[28031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016792, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260806 11:46:32.897264 28754 tablet.cc:2369] T 1e7013090db64f01971b78791e71ebd2 P 11f006ff6afa4022a721f7e8b7e9cf02: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 11:46:32 dist-test-slave-7z32 krb5kdc[28031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016792, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:46:32.911725 28775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.899056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57952 (local address 127.26.172.193:45307)
0806 11:46:32.899332 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.899339 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.899538 (+ 199us) server_negotiation.cc:407] Connection header received
0806 11:46:32.899864 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.899868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.899923 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.900028 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:32.900924 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.901513 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.902451 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.902706 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.902832 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.906301 (+ 3469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:32.906306 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:32.906308 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:32.906351 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:32.908342 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.909424 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.909431 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.909432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.909620 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.910271 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.910281 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.910282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.910579 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:32.910732 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.911309 (+ 577us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.911527 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
Aug 06 11:46:32 dist-test-slave-7z32 krb5kdc[28031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 11:46:32 dist-test-slave-7z32 krb5kdc[28031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:46:32.952625 28775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:32.941060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57962 (local address 127.26.172.193:45307)
0806 11:46:32.941281 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:32.941287 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:32.941538 (+ 251us) server_negotiation.cc:407] Connection header received
0806 11:46:32.941812 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:32.941816 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:32.941874 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:32.941984 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:32.942974 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.943601 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.944684 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:32.944951 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:32.945085 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:32.948717 (+ 3632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:32.948722 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:32.948725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:32.948766 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:32.950472 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.951137 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.951142 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.951144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.951253 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:32.951582 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:32.951586 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:32.951588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:32.951817 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:32.951973 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:32.952266 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 11:46:32.952414 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
W20260806 11:46:32.954499 28233 tablet_service.cc:2908] Rejecting scan request for tablet 1e7013090db64f01971b78791e71ebd2: Uninitialized: clean time has not yet been initialized
I20260806 11:46:32.957964 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 28174
I20260806 11:46:32.974293 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 28359
I20260806 11:46:32.990090 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 28548
I20260806 11:46:33.008407 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 28055
2026-08-06T11:46:33Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (3170 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:46:33 dist-test-slave-7z32 krb5kdc[28813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:46:33 dist-test-slave-7z32 krb5kdc[28813](info): set up 2 sockets
Aug 06 11:46:33 dist-test-slave-7z32 krb5kdc[28813](info): commencing operation
krb5kdc: starting...
W20260806 11:46:34.318631 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:46:34 dist-test-slave-7z32 krb5kdc[28813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:46:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:46:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:46:34.504451 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:33227
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:33227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:34.657640 28829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:34.658082 28829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:34.658134 28829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:34.663869 28829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:46:34.664014 28829 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 11:46:34.664038 28829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:34.664170 28829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:34.664347 28829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:46:34.664384 28829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:46:34.673198 28829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:33227
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:33227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:34.675240 28829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:34.676852 28829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:34.690054 28840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:34.690021 28836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:34.690035 28838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:34.690658 28829 server_base.cc:1034] running on GCE node
I20260806 11:46:34.691434 28829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:34.692914 28829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:34.694211 28829 hybrid_clock.cc:648] HybridClock initialized: now 1786016794694189 us; error 64 us; skew 500 ppm
Aug 06 11:46:34 dist-test-slave-7z32 krb5kdc[28813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016794, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:34.698132 28829 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:46:34.699451 28829 webserver.cc:460] Webserver started at http://127.26.172.254:46133/ using document root <none> and password file <none>
I20260806 11:46:34.700182 28829 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:34.700299 28829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:34.700598 28829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:34.703135 28829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "be4cb336344d442c9c31635e7814a51c"
format_stamp: "Formatted at 2026-08-06 11:46:34 on dist-test-slave-7z32"
server_key: "cb10d77a60998f65221705441bd12064"
server_key_iv: "e74c0dfca757a9d36a1d107595c17aeb"
server_key_version: "encryptionkey@0"
I20260806 11:46:34.703811 28829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "be4cb336344d442c9c31635e7814a51c"
format_stamp: "Formatted at 2026-08-06 11:46:34 on dist-test-slave-7z32"
server_key: "cb10d77a60998f65221705441bd12064"
server_key_iv: "e74c0dfca757a9d36a1d107595c17aeb"
server_key_version: "encryptionkey@0"
I20260806 11:46:34.708916 28829 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:46:34.713119 28847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:34.715510 28829 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:46:34.715720 28829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "be4cb336344d442c9c31635e7814a51c"
format_stamp: "Formatted at 2026-08-06 11:46:34 on dist-test-slave-7z32"
server_key: "cb10d77a60998f65221705441bd12064"
server_key_iv: "e74c0dfca757a9d36a1d107595c17aeb"
server_key_version: "encryptionkey@0"
I20260806 11:46:34.715879 28829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:34.737593 28829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:34.741835 28829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:34.742096 28829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:34.753057 28829 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:33227
I20260806 11:46:34.753129 28947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:33227 every 8 connection(s)
I20260806 11:46:34.754311 28829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:46:34.756242 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 28829
I20260806 11:46:34.756372 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:46:34.756693 27315 external_mini_cluster.cc:1428] Setting key e13afd504ab3a54f083d2f6e31fb0a4e
I20260806 11:46:34.759162 28948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:34.769014 28948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c: Bootstrap starting.
Aug 06 11:46:34 dist-test-slave-7z32 krb5kdc[28813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016794, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:34.772791 28948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:34.774430 28948 log.cc:824] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:34.777665 28953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:34.758978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44734 (local address 127.26.172.254:33227)
0806 11:46:34.759634 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:34.759661 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:34.759723 (+ 62us) server_negotiation.cc:407] Connection header received
0806 11:46:34.760525 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:34.760551 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:34.761195 (+ 644us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:34.761666 (+ 471us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:34.763060 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:34.764822 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:34.766246 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:34.767127 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:34.767383 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:34.771035 (+ 3652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:34.771044 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:34.771068 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:34.771123 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:34.773414 (+ 2291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:34.774202 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:34.774209 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:34.774215 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:34.774375 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:34.774764 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:34.774767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:34.774768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:34.775529 (+ 761us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:34.775754 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:34.776289 (+ 535us) server_negotiation.cc:299] Negotiation successful
0806 11:46:34.776700 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":240,"threads_started":1}
I20260806 11:46:34.777751 28948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c: No bootstrap required, opened a new log
I20260806 11:46:34.782021 28948 raft_consensus.cc:348] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4cb336344d442c9c31635e7814a51c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33227 } }
I20260806 11:46:34.782382 28948 raft_consensus.cc:374] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:34.782469 28948 raft_consensus.cc:729] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be4cb336344d442c9c31635e7814a51c, State: Initialized, Role: FOLLOWER
I20260806 11:46:34.783147 28948 consensus_queue.cc:260] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4cb336344d442c9c31635e7814a51c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33227 } }
I20260806 11:46:34.783380 28948 raft_consensus.cc:388] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:46:34.783491 28948 raft_consensus.cc:482] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:46:34.783638 28948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:34.785113 28948 raft_consensus.cc:504] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4cb336344d442c9c31635e7814a51c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33227 } }
I20260806 11:46:34.785537 28948 leader_election.cc:302] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be4cb336344d442c9c31635e7814a51c; no voters:
I20260806 11:46:34.785981 28948 leader_election.cc:288] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:46:34.786254 28957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:34.786651 28957 raft_consensus.cc:686] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [term 1 LEADER]: Becoming Leader. State: Replica: be4cb336344d442c9c31635e7814a51c, State: Running, Role: LEADER
I20260806 11:46:34.787148 28957 consensus_queue.cc:237] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4cb336344d442c9c31635e7814a51c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33227 } }
I20260806 11:46:34.787935 28948 sys_catalog.cc:564] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:46:34.789333 28958 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be4cb336344d442c9c31635e7814a51c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4cb336344d442c9c31635e7814a51c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33227 } } }
I20260806 11:46:34.789942 28958 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:34.789796 28959 sys_catalog.cc:455] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [sys.catalog]: SysCatalogTable state changed. Reason: New leader be4cb336344d442c9c31635e7814a51c. Latest consensus state: current_term: 1 leader_uuid: "be4cb336344d442c9c31635e7814a51c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be4cb336344d442c9c31635e7814a51c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33227 } } }
I20260806 11:46:34.790385 28959 sys_catalog.cc:458] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c [sys.catalog]: This master's current role is: LEADER
W20260806 11:46:34.794557 28977 catalog_manager.cc:1558] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:46:34.794708 28977 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:46:34.794906 28973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:46:34.795995 28973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:46:34.805910 28973 catalog_manager.cc:1347] Generated new cluster ID: 43c59f86e44c486aacca4a74492fbe7b
I20260806 11:46:34.806051 28973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:46:34.834187 28973 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:46:34.836061 28973 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:46:34.852274 28973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c: Generated new TSK 0
I20260806 11:46:34.853685 28973 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:46:34.896112 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33227
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:35.047652 28988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:35.048039 28988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:35.048127 28988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:35.052433 28988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:35.052563 28988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:35.052642 28988 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 11:46:35.052737 28988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:46:35.060214 28988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.172.254:33227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:35.062047 28988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:35.063724 28988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:35.078060 28996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:35.078136 28999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:35.078135 28993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:35.078375 28988 server_base.cc:1034] running on GCE node
I20260806 11:46:35.079293 28988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:35.080188 28988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:35.083586 28988 hybrid_clock.cc:648] HybridClock initialized: now 1786016795083466 us; error 125 us; skew 500 ppm
Aug 06 11:46:35 dist-test-slave-7z32 krb5kdc[28813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016795, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:35.087559 28988 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:46:35.089046 28988 webserver.cc:460] Webserver started at http://127.26.172.193:38463/ using document root <none> and password file <none>
I20260806 11:46:35.089767 28988 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:35.089918 28988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:35.090162 28988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:35.092566 28988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "37668ab4de614003b3c5e2f20a840896"
format_stamp: "Formatted at 2026-08-06 11:46:35 on dist-test-slave-7z32"
server_key: "2f7d4c11ae6b30fa2f7f41d842b8b576"
server_key_iv: "268b762362e84f6905a3e8cab30a0dae"
server_key_version: "encryptionkey@0"
I20260806 11:46:35.093149 28988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "37668ab4de614003b3c5e2f20a840896"
format_stamp: "Formatted at 2026-08-06 11:46:35 on dist-test-slave-7z32"
server_key: "2f7d4c11ae6b30fa2f7f41d842b8b576"
server_key_iv: "268b762362e84f6905a3e8cab30a0dae"
server_key_version: "encryptionkey@0"
I20260806 11:46:35.097966 28988 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:46:35.101486 29007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:35.103540 28988 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 11:46:35.103763 28988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "37668ab4de614003b3c5e2f20a840896"
format_stamp: "Formatted at 2026-08-06 11:46:35 on dist-test-slave-7z32"
server_key: "2f7d4c11ae6b30fa2f7f41d842b8b576"
server_key_iv: "268b762362e84f6905a3e8cab30a0dae"
server_key_version: "encryptionkey@0"
I20260806 11:46:35.103924 28988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:35.128082 28988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:35.133877 28988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:35.134140 28988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:35.136125 28988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:35.136196 28988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:35.136242 28988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:35.136278 28988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:35.150430 28988 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:36693
I20260806 11:46:35.150730 29171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:36693 every 8 connection(s)
Aug 06 11:46:35 dist-test-slave-7z32 krb5kdc[28813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016795, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:35.151880 28988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:46:35.158015 28953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.138068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:48145 (local address 127.26.172.254:33227)
0806 11:46:35.138320 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.138327 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.139949 (+ 1622us) server_negotiation.cc:407] Connection header received
0806 11:46:35.141616 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.141620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.141710 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.141823 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:35.144086 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.145179 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.147351 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.147795 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.147944 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.152225 (+ 4281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:35.152253 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:35.152259 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:35.152318 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:35.154560 (+ 2242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.155579 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.155583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.155584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.155772 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.156389 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.156394 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.156396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.156708 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:35.156831 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.157626 (+ 795us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.157840 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 11:46:35.159067 29028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.138942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33227 (local address 127.26.172.193:48145)
0806 11:46:35.139696 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.139768 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.141226 (+ 1458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.142088 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.142100 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.142732 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:35.143783 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.143817 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.145428 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.145434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.147179 (+ 1745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.147194 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.148079 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.148091 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.148483 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.149429 (+ 946us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:35.149454 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:35.151695 (+ 2241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:35.154801 (+ 3106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.154808 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.154894 (+ 86us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.155407 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.155932 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.155935 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.155936 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.156127 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.156864 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:35.156871 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:35.157213 (+ 342us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.157417 (+ 204us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.157843 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":260,"threads_started":1}
I20260806 11:46:35.160282 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 28988
I20260806 11:46:35.160435 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:46:35.160822 27315 external_mini_cluster.cc:1428] Setting key 0557663b84411ad005556bf268929f5c
I20260806 11:46:35.161366 29173 heartbeater.cc:347] Connected to a master server at 127.26.172.254:33227
I20260806 11:46:35.161641 29173 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:35.162508 29173 heartbeater.cc:511] Master 127.26.172.254:33227 requested a full tablet report, sending...
I20260806 11:46:35.164891 28867 ts_manager.cc:194] Registered new tserver with Master: 37668ab4de614003b3c5e2f20a840896 (127.26.172.193:36693)
I20260806 11:46:35.166563 28867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:48145
I20260806 11:46:35.176517 28953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.164625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:48699 (local address 127.26.172.254:33227)
0806 11:46:35.164777 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.164781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.165145 (+ 364us) server_negotiation.cc:407] Connection header received
0806 11:46:35.165388 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.165395 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.165481 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.165596 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:35.166329 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.167295 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.168784 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.169149 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.169297 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.171569 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:35.171573 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:35.171576 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:35.171608 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:35.173558 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.174462 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.174466 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.174468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.174616 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.175126 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.175130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.175131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.175369 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:35.175662 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.176182 (+ 520us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.176365 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:46:35.176606 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.164494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33227 (local address 127.26.172.193:48699)
0806 11:46:35.165030 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.165050 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.165234 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.165653 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.165656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.165943 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:35.166110 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.166118 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.167545 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.167552 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.168592 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.168611 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.169337 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.169343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.169484 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.170283 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:35.170310 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:35.171273 (+ 963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:35.173767 (+ 2494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.173773 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.173777 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.174178 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.174764 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.174769 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.174771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.174962 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.175664 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:35.175668 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:35.175864 (+ 196us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.176044 (+ 180us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.176298 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":163,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:46:35.210891 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33227
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:35.375306 29189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:35.375711 29189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:35.375769 29189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:35.380752 29189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:35.380877 29189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:35.380924 29189 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 11:46:35.380964 29189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:46:35.387735 29189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.172.254:33227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:35.389688 29189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:35.391332 29189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:35.404872 29195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:35.404834 29198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:35.404954 29194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:35.405225 29189 server_base.cc:1034] running on GCE node
I20260806 11:46:35.405999 29189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:35.407091 29189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:35.408385 29189 hybrid_clock.cc:648] HybridClock initialized: now 1786016795408319 us; error 91 us; skew 500 ppm
Aug 06 11:46:35 dist-test-slave-7z32 krb5kdc[28813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016795, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:35.413147 29189 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:46:35.415041 29189 webserver.cc:460] Webserver started at http://127.26.172.194:33527/ using document root <none> and password file <none>
I20260806 11:46:35.416400 29189 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:35.416654 29189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:35.417013 29189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:35.420323 29189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "82c2a9a6808d405d8f7e89feb9ac88e9"
format_stamp: "Formatted at 2026-08-06 11:46:35 on dist-test-slave-7z32"
server_key: "aa620962297031941ae6e18ae856600f"
server_key_iv: "695c49c8a897b3d8b10e096af9258200"
server_key_version: "encryptionkey@0"
I20260806 11:46:35.421332 29189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "82c2a9a6808d405d8f7e89feb9ac88e9"
format_stamp: "Formatted at 2026-08-06 11:46:35 on dist-test-slave-7z32"
server_key: "aa620962297031941ae6e18ae856600f"
server_key_iv: "695c49c8a897b3d8b10e096af9258200"
server_key_version: "encryptionkey@0"
I20260806 11:46:35.427868 29189 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 11:46:35.432617 29209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:35.435047 29189 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:46:35.435320 29189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "82c2a9a6808d405d8f7e89feb9ac88e9"
format_stamp: "Formatted at 2026-08-06 11:46:35 on dist-test-slave-7z32"
server_key: "aa620962297031941ae6e18ae856600f"
server_key_iv: "695c49c8a897b3d8b10e096af9258200"
server_key_version: "encryptionkey@0"
I20260806 11:46:35.435528 29189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:35.458271 29189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:35.464022 29189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:35.464347 29189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:35.466668 29189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:35.466773 29189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:35.466878 29189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:35.466926 29189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Aug 06 11:46:35 dist-test-slave-7z32 krb5kdc[28813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016795, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:35.481806 29189 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:39325
I20260806 11:46:35.481948 29362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:39325 every 8 connection(s)
I20260806 11:46:35.483340 29189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:46:35.484011 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 29189
I20260806 11:46:35.484182 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:46:35.484552 27315 external_mini_cluster.cc:1428] Setting key 80482348035a1bbe30cccba0c27c4a25
I20260806 11:46:35.486733 28953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.468056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:60195 (local address 127.26.172.254:33227)
0806 11:46:35.468282 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.468288 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.469564 (+ 1276us) server_negotiation.cc:407] Connection header received
0806 11:46:35.471475 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.471482 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.471581 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.471709 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:35.473849 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.474473 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.476356 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.476744 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.476941 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.480818 (+ 3877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:35.480827 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:35.480834 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:35.480890 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:35.483095 (+ 2205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.484148 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.484153 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.484156 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.484369 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.484891 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.484895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.484897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.485214 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:35.485372 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.486333 (+ 961us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.486588 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 11:46:35.488268 29221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.468520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33227 (local address 127.26.172.194:60195)
0806 11:46:35.469282 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.469372 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.471038 (+ 1666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.472015 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.472026 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.472639 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:35.473622 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.473650 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.474647 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.474657 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.476157 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.476172 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.477074 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.477081 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.477304 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.478128 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:35.478151 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:35.480462 (+ 2311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:35.483287 (+ 2825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.483295 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.483326 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.483813 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.484522 (+ 709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.484526 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.484528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.484747 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.485386 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:35.485395 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:35.485856 (+ 461us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.486156 (+ 300us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.486699 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":161,"threads_started":1}
I20260806 11:46:35.490636 29364 heartbeater.cc:347] Connected to a master server at 127.26.172.254:33227
I20260806 11:46:35.491003 29364 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:35.491976 29364 heartbeater.cc:511] Master 127.26.172.254:33227 requested a full tablet report, sending...
I20260806 11:46:35.496381 28871 ts_manager.cc:194] Registered new tserver with Master: 82c2a9a6808d405d8f7e89feb9ac88e9 (127.26.172.194:39325)
I20260806 11:46:35.497402 28871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:60195
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:46:35.505201 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.493600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33227 (local address 127.26.172.194:51867)
0806 11:46:35.494304 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.494329 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.494501 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.495242 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.495249 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.495665 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:35.495902 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.495913 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.497150 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.497153 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.497867 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.497882 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.498679 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.498683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.498804 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.499740 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:35.499758 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:35.500346 (+ 588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:35.502947 (+ 2601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.502956 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.502959 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.503386 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.503828 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.503832 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.503834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.503932 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.504486 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:35.504490 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:35.504616 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.504742 (+ 126us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.504960 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":373,"threads_started":1}
I20260806 11:46:35.505196 28953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.493769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:51867 (local address 127.26.172.254:33227)
0806 11:46:35.494860 (+ 1091us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.494866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.494888 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:46:35.494954 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.494960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.495036 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.495186 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:35.496098 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.496975 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.498019 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.498366 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.498454 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.500692 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:35.500697 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:35.500701 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:35.500743 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:35.502668 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.503574 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.503579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.503580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.503703 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.504049 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.504053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.504057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.504365 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:35.504500 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.504808 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.504958 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":951}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:46:35.532793 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33227
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:35.674479 29376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:35.675047 29376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:35.675184 29376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:35.680269 29376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:35.680378 29376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:35.680423 29376 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 11:46:35.680460 29376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:46:35.687181 29376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.172.254:33227
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:35.689085 29376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:35.690604 29376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:35.703516 29382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:35.703626 29376 server_base.cc:1034] running on GCE node
W20260806 11:46:35.703433 29381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:35.703433 29388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:35.704618 29376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:35.705498 29376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:35.706875 29376 hybrid_clock.cc:648] HybridClock initialized: now 1786016795706777 us; error 72 us; skew 500 ppm
Aug 06 11:46:35 dist-test-slave-7z32 krb5kdc[28813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016795, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:35.710393 29376 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:46:35.711783 29376 webserver.cc:460] Webserver started at http://127.26.172.195:45161/ using document root <none> and password file <none>
I20260806 11:46:35.712496 29376 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:35.712577 29376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:35.712839 29376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:35.715389 29376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "2611d4383bef4ba3b6f3639e7314a0f7"
format_stamp: "Formatted at 2026-08-06 11:46:35 on dist-test-slave-7z32"
server_key: "e3a247254400154e4792e722b3889c2b"
server_key_iv: "77baf18dc179a4159fbd919d30aa8801"
server_key_version: "encryptionkey@0"
I20260806 11:46:35.716101 29376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "2611d4383bef4ba3b6f3639e7314a0f7"
format_stamp: "Formatted at 2026-08-06 11:46:35 on dist-test-slave-7z32"
server_key: "e3a247254400154e4792e722b3889c2b"
server_key_iv: "77baf18dc179a4159fbd919d30aa8801"
server_key_version: "encryptionkey@0"
I20260806 11:46:35.721761 29376 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:46:35.725579 29398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:35.727624 29376 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 11:46:35.727819 29376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "2611d4383bef4ba3b6f3639e7314a0f7"
format_stamp: "Formatted at 2026-08-06 11:46:35 on dist-test-slave-7z32"
server_key: "e3a247254400154e4792e722b3889c2b"
server_key_iv: "77baf18dc179a4159fbd919d30aa8801"
server_key_version: "encryptionkey@0"
I20260806 11:46:35.728044 29376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:35.766093 29376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:35.770394 29376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:35.770586 29376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:35.772257 29376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:35.772336 29376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:35.772383 29376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:35.772446 29376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:35.785880 29376 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:42847
I20260806 11:46:35.786211 29555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:42847 every 8 connection(s)
Aug 06 11:46:35 dist-test-slave-7z32 krb5kdc[28813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016795, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:35.787505 29376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:46:35.793658 28953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.774268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:52855 (local address 127.26.172.254:33227)
0806 11:46:35.774440 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.774444 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.775835 (+ 1391us) server_negotiation.cc:407] Connection header received
0806 11:46:35.778321 (+ 2486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.778329 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.778437 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.778597 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:35.780917 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.781917 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.783755 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.784206 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.784387 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.787932 (+ 3545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:35.787942 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:35.787949 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:35.788028 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:35.790337 (+ 2309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.791429 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.791434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.791436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.791573 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.792053 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.792056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.792057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.792348 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:35.792444 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.793326 (+ 882us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.793489 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 11:46:35.795250 29409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.774770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33227 (local address 127.26.172.195:52855)
0806 11:46:35.775524 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.775671 (+ 147us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.777867 (+ 2196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.779036 (+ 1169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.779051 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.779700 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:35.780615 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.780640 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.782153 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.782157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.783526 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.783545 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.784467 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.784473 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.784725 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.785560 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:35.785588 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:35.787580 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:35.790540 (+ 2960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.790548 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.790565 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.791056 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.791713 (+ 657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.791716 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.791717 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.791922 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.792637 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:35.792644 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:35.793002 (+ 358us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.793209 (+ 207us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.793561 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":138,"threads_started":1}
I20260806 11:46:35.797024 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 29376
I20260806 11:46:35.797230 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:46:35.797610 27315 external_mini_cluster.cc:1428] Setting key c9886d0f6e2a3f646db8cd0899a2b601
I20260806 11:46:35.797958 29557 heartbeater.cc:347] Connected to a master server at 127.26.172.254:33227
I20260806 11:46:35.798214 29557 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:35.799141 29557 heartbeater.cc:511] Master 127.26.172.254:33227 requested a full tablet report, sending...
I20260806 11:46:35.800719 28867 ts_manager.cc:194] Registered new tserver with Master: 2611d4383bef4ba3b6f3639e7314a0f7 (127.26.172.195:42847)
I20260806 11:46:35.801538 28867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:52855
I20260806 11:46:35.813015 28953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.802607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:60655 (local address 127.26.172.254:33227)
0806 11:46:35.802786 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.802792 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.802810 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:46:35.802909 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.802912 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.802973 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.803086 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:35.803697 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.804492 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.805757 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.806018 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.806160 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.807821 (+ 1661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:35.807825 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:35.807827 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:35.807858 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:35.810077 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.811138 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.811143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.811145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.811276 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.811709 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.811713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.811715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.812024 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:35.812203 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.812624 (+ 421us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.812820 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 11:46:35.813022 29565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.802059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33227 (local address 127.26.172.195:60655)
0806 11:46:35.802459 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.802507 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.802668 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.803132 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.803134 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.803370 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:35.803548 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.803556 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.804747 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.804750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.805556 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.805569 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.806225 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.806228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.806330 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.807090 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:35.807103 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:35.807608 (+ 505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:35.810378 (+ 2770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.810382 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.810384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.810747 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.811432 (+ 685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:35.811436 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:35.811438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:35.811573 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:35.812178 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:35.812182 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:35.812345 (+ 163us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.812526 (+ 181us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.812778 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":184,"threads_started":1}
I20260806 11:46:35.813676 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 11:46:35 dist-test-slave-7z32 krb5kdc[28813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016795, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 11:46:35 dist-test-slave-7z32 krb5kdc[28813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016795, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:35.853432 28953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.841516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44744 (local address 127.26.172.254:33227)
0806 11:46:35.841726 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.841734 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.841752 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:46:35.841817 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.841820 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.841871 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.842155 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:35.843474 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.844355 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.845408 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.845659 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.845813 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.849370 (+ 3557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:35.849374 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:35.849377 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:35.849474 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:35.851294 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.851915 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.851919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.851921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.852026 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:35.852342 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:35.852347 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:35.852348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:35.852595 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:35.852789 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.853088 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.853233 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 11:46:35.858569 28867 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:46:35.863886 28867 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:35.884794 29587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.877577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:42847 (local address 127.0.0.1:46696)
0806 11:46:35.878592 (+ 1015us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.878609 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.878726 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.879915 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.879919 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.879940 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:35.880111 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.880125 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.881614 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.881620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.882638 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.882650 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.884072 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.884076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.884234 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.884294 (+ 60us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.884410 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.884585 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"mutex_wait_us":1,"thread_start_us":177,"threads_started":1}
I20260806 11:46:35.884989 29590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.877554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38148 (local address 127.26.172.193:36693)
0806 11:46:35.879049 (+ 1495us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.879060 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.879094 (+ 34us) server_negotiation.cc:407] Connection header received
0806 11:46:35.879192 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.879198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.879448 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.879640 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:35.880008 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.881160 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.883144 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.883950 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.884084 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.884256 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.884686 (+ 430us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.884822 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1351,"thread_start_us":119,"threads_started":1}
I20260806 11:46:35.885445 29588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.877399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:36693 (local address 127.0.0.1:38148)
0806 11:46:35.878098 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.878160 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.878322 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.879645 (+ 1323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.879651 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.879679 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:35.879845 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.879854 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.881309 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.881314 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.882962 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.882976 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.884331 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.884334 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.884437 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.884457 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.884522 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.884585 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":306,"threads_started":1}
I20260806 11:46:35.886057 29591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.878492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46696 (local address 127.26.172.195:42847)
0806 11:46:35.879333 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.879348 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.879380 (+ 32us) server_negotiation.cc:407] Connection header received
0806 11:46:35.879491 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.879504 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.879726 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.879945 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:35.880280 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.881484 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.882892 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.883877 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.885384 (+ 1507us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.885627 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.885701 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.885846 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":219,"threads_started":1}
I20260806 11:46:35.886355 29592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.878755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:39325 (local address 127.0.0.1:57534)
0806 11:46:35.879219 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.879237 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.879366 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.881407 (+ 2041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.881410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.881430 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:35.881577 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.881584 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.883152 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.883155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.884026 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.884038 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.885786 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.885791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.885898 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.885926 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.886021 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.886188 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":138,"threads_started":1}
I20260806 11:46:35.886785 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.878967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57534 (local address 127.26.172.194:39325)
0806 11:46:35.880590 (+ 1623us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.880602 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.880630 (+ 28us) server_negotiation.cc:407] Connection header received
0806 11:46:35.880716 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.880722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.881232 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.881407 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:35.881733 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.883009 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.884195 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.885413 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.885584 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.885705 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.886129 (+ 424us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.886637 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1503,"thread_start_us":139,"threads_started":1}
I20260806 11:46:35.889981 29273 tablet_service.cc:1467] Processing CreateTablet for tablet 8daf337d05ff47b494f153b1f4fdf737 (DEFAULT_TABLE table=test-table [id=5eb73258abbd4bcf92d6318c26db3fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:35.889964 29074 tablet_service.cc:1467] Processing CreateTablet for tablet 8daf337d05ff47b494f153b1f4fdf737 (DEFAULT_TABLE table=test-table [id=5eb73258abbd4bcf92d6318c26db3fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:35.890190 29454 tablet_service.cc:1467] Processing CreateTablet for tablet 8daf337d05ff47b494f153b1f4fdf737 (DEFAULT_TABLE table=test-table [id=5eb73258abbd4bcf92d6318c26db3fd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:35.891644 29273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8daf337d05ff47b494f153b1f4fdf737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:35.891644 29074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8daf337d05ff47b494f153b1f4fdf737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:35.891961 29454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8daf337d05ff47b494f153b1f4fdf737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:35.902267 29594 tablet_bootstrap.cc:492] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: Bootstrap starting.
I20260806 11:46:35.904660 29595 tablet_bootstrap.cc:492] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: Bootstrap starting.
I20260806 11:46:35.904907 29596 tablet_bootstrap.cc:492] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: Bootstrap starting.
I20260806 11:46:35.905524 29594 tablet_bootstrap.cc:654] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:35.906497 29594 log.cc:824] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:35.907943 29596 tablet_bootstrap.cc:654] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:35.907943 29595 tablet_bootstrap.cc:654] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:35.909195 29595 log.cc:824] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:35.909195 29596 log.cc:824] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:35.909725 29594 tablet_bootstrap.cc:492] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: No bootstrap required, opened a new log
I20260806 11:46:35.910014 29594 ts_tablet_manager.cc:1397] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 11:46:35.912473 29596 tablet_bootstrap.cc:492] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: No bootstrap required, opened a new log
I20260806 11:46:35.912501 29595 tablet_bootstrap.cc:492] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: No bootstrap required, opened a new log
I20260806 11:46:35.912822 29595 ts_tablet_manager.cc:1397] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 11:46:35.912843 29596 ts_tablet_manager.cc:1397] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 11:46:35.915277 29594 raft_consensus.cc:348] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:35.915706 29594 raft_consensus.cc:374] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:35.915764 29594 raft_consensus.cc:729] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2611d4383bef4ba3b6f3639e7314a0f7, State: Initialized, Role: FOLLOWER
I20260806 11:46:35.916406 29594 consensus_queue.cc:260] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:35.917840 29594 ts_tablet_manager.cc:1428] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260806 11:46:35.917773 29596 raft_consensus.cc:348] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:35.918253 29596 raft_consensus.cc:374] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:35.918360 29596 raft_consensus.cc:729] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82c2a9a6808d405d8f7e89feb9ac88e9, State: Initialized, Role: FOLLOWER
I20260806 11:46:35.918610 29557 heartbeater.cc:503] Master 127.26.172.254:33227 was elected leader, sending a full tablet report...
I20260806 11:46:35.918509 29595 raft_consensus.cc:348] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:35.918893 29595 raft_consensus.cc:374] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:35.918963 29595 raft_consensus.cc:729] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37668ab4de614003b3c5e2f20a840896, State: Initialized, Role: FOLLOWER
I20260806 11:46:35.919099 29596 consensus_queue.cc:260] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:35.919682 29595 consensus_queue.cc:260] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:35.920770 29173 heartbeater.cc:503] Master 127.26.172.254:33227 was elected leader, sending a full tablet report...
I20260806 11:46:35.921149 29595 ts_tablet_manager.cc:1428] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260806 11:46:35.922106 29596 ts_tablet_manager.cc:1428] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260806 11:46:35.922729 29364 heartbeater.cc:503] Master 127.26.172.254:33227 was elected leader, sending a full tablet report...
I20260806 11:46:35.937888 29601 raft_consensus.cc:482] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:35.938704 29601 raft_consensus.cc:504] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:35.941344 29601 leader_election.cc:288] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37668ab4de614003b3c5e2f20a840896 (127.26.172.193:36693), 2611d4383bef4ba3b6f3639e7314a0f7 (127.26.172.195:42847)
I20260806 11:46:35.947553 29590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.941913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:47859 (local address 127.26.172.193:36693)
0806 11:46:35.942110 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.942116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.942466 (+ 350us) server_negotiation.cc:407] Connection header received
0806 11:46:35.942549 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.942553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.942612 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.942696 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:35.943488 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.944323 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.945731 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.946467 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.946639 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.946703 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.947325 (+ 622us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.947421 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 11:46:35.947594 29221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.941736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:36693 (local address 127.26.172.194:47859)
0806 11:46:35.942181 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.942202 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.942348 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.942932 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.942935 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.942998 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:35.943207 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.943219 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.944507 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.944511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.945525 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.945537 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.946925 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.946931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.947112 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.947154 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.947270 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.947382 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334}
I20260806 11:46:35.948871 29605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.941863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:42847 (local address 127.26.172.194:42559)
0806 11:46:35.943032 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:35.943053 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:35.943190 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:35.943546 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:35.943550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:35.943574 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:35.943746 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.943755 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.944845 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.944848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.946868 (+ 2020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:35.946882 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.948032 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.948038 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:35.948307 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.948443 (+ 136us) client_negotiation.cc:769] Sending connection context
0806 11:46:35.948581 (+ 138us) client_negotiation.cc:240] Negotiation successful
0806 11:46:35.948694 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1017,"thread_start_us":224,"threads_started":1}
I20260806 11:46:35.948901 29591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.942282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:42559 (local address 127.26.172.195:42847)
0806 11:46:35.942453 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.942459 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.943178 (+ 719us) server_negotiation.cc:407] Connection header received
0806 11:46:35.943306 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.943312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.943384 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.943470 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:35.943952 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.944658 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.947041 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.947693 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.947856 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:35.947926 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:35.948655 (+ 729us) server_negotiation.cc:299] Negotiation successful
0806 11:46:35.948775 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 11:46:35.949046 29111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8daf337d05ff47b494f153b1f4fdf737" candidate_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37668ab4de614003b3c5e2f20a840896" is_pre_election: true
I20260806 11:46:35.949604 29111 raft_consensus.cc:2454] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82c2a9a6808d405d8f7e89feb9ac88e9 in term 0.
I20260806 11:46:35.949939 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8daf337d05ff47b494f153b1f4fdf737" candidate_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" is_pre_election: true
I20260806 11:46:35.950371 29488 raft_consensus.cc:2454] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82c2a9a6808d405d8f7e89feb9ac88e9 in term 0.
I20260806 11:46:35.950459 29213 leader_election.cc:302] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37668ab4de614003b3c5e2f20a840896, 82c2a9a6808d405d8f7e89feb9ac88e9; no voters:
I20260806 11:46:35.950968 29601 raft_consensus.cc:2781] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:35.951095 29601 raft_consensus.cc:482] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:35.951128 29601 raft_consensus.cc:3037] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:35.952462 29601 raft_consensus.cc:504] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:35.952976 29601 leader_election.cc:288] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [CANDIDATE]: Term 1 election: Requested vote from peers 37668ab4de614003b3c5e2f20a840896 (127.26.172.193:36693), 2611d4383bef4ba3b6f3639e7314a0f7 (127.26.172.195:42847)
I20260806 11:46:35.953787 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8daf337d05ff47b494f153b1f4fdf737" candidate_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2611d4383bef4ba3b6f3639e7314a0f7"
I20260806 11:46:35.954031 29488 raft_consensus.cc:3037] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:35.954120 29111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8daf337d05ff47b494f153b1f4fdf737" candidate_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37668ab4de614003b3c5e2f20a840896"
I20260806 11:46:35.954413 29111 raft_consensus.cc:3037] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:35.955487 29488 raft_consensus.cc:2454] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82c2a9a6808d405d8f7e89feb9ac88e9 in term 1.
I20260806 11:46:35.956084 29210 leader_election.cc:302] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2611d4383bef4ba3b6f3639e7314a0f7, 82c2a9a6808d405d8f7e89feb9ac88e9; no voters:
I20260806 11:46:35.956266 29111 raft_consensus.cc:2454] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82c2a9a6808d405d8f7e89feb9ac88e9 in term 1.
I20260806 11:46:35.956519 29601 raft_consensus.cc:2781] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:35.956918 29601 raft_consensus.cc:686] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 LEADER]: Becoming Leader. State: Replica: 82c2a9a6808d405d8f7e89feb9ac88e9, State: Running, Role: LEADER
I20260806 11:46:35.957474 29601 consensus_queue.cc:237] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:35.962626 28871 catalog_manager.cc:5495] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82c2a9a6808d405d8f7e89feb9ac88e9 (127.26.172.194). New cstate: current_term: 1 leader_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } health_report { overall_health: UNKNOWN } } }
W20260806 11:46:35.985862 29365 tablet.cc:2369] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:46:36.002712 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:35.996655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57546 (local address 127.26.172.194:39325)
0806 11:46:35.996811 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:35.996814 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:35.996870 (+ 56us) server_negotiation.cc:407] Connection header received
0806 11:46:35.997270 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:35.997274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:35.997349 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:35.997494 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:35.998012 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:35.998660 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:35.999927 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.000200 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.000344 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.001021 (+ 677us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:36.001637 (+ 616us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:36.001779 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.002240 (+ 461us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.002347 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 11:46:36.013164 29111 raft_consensus.cc:1261] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896 [term 1 FOLLOWER]: Refusing update from remote peer 82c2a9a6808d405d8f7e89feb9ac88e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:36.013435 29488 raft_consensus.cc:1261] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 FOLLOWER]: Refusing update from remote peer 82c2a9a6808d405d8f7e89feb9ac88e9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:36.014923 29606 consensus_queue.cc:1035] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:36.015409 29601 consensus_queue.cc:1035] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:36.054893 28867 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:36.055421 28867 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:36.059633 28867 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c: Sending DeleteTablet for 3 replicas of tablet 8daf337d05ff47b494f153b1f4fdf737
I20260806 11:46:36.061198 29074 tablet_service.cc:1514] Processing DeleteTablet for tablet 8daf337d05ff47b494f153b1f4fdf737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:36 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:38148
I20260806 11:46:36.061277 29273 tablet_service.cc:1514] Processing DeleteTablet for tablet 8daf337d05ff47b494f153b1f4fdf737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:36 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:57534
I20260806 11:46:36.061259 29454 tablet_service.cc:1514] Processing DeleteTablet for tablet 8daf337d05ff47b494f153b1f4fdf737 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:36 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:46696
I20260806 11:46:36.061982 29626 tablet_replica.cc:330] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: stopping tablet replica
I20260806 11:46:36.062448 29628 tablet_replica.cc:330] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: stopping tablet replica
I20260806 11:46:36.062449 29626 raft_consensus.cc:2229] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:36.062879 29626 raft_consensus.cc:2258] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:36.063218 29628 raft_consensus.cc:2229] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:36.063814 29628 raft_consensus.cc:2258] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:36.064028 28867 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44744:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 11:46:36.064687 29629 tablet_replica.cc:330] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: stopping tablet replica
W20260806 11:46:36.064769 28867 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:36.065840 29626 ts_tablet_manager.cc:1905] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:36.066514 29629 raft_consensus.cc:2229] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:46:36.067773 29628 ts_tablet_manager.cc:1905] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:36.068550 29629 raft_consensus.cc:2258] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:36.070096 29626 ts_tablet_manager.cc:1918] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:46:36.070268 29626 log.cc:1196] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/8daf337d05ff47b494f153b1f4fdf737
I20260806 11:46:36.070676 29626 ts_tablet_manager.cc:1939] T 8daf337d05ff47b494f153b1f4fdf737 P 37668ab4de614003b3c5e2f20a840896: Deleting consensus metadata
I20260806 11:46:36.072046 29629 ts_tablet_manager.cc:1905] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:36.072603 28851 catalog_manager.cc:4841] TS 37668ab4de614003b3c5e2f20a840896 (127.26.172.193:36693): tablet 8daf337d05ff47b494f153b1f4fdf737 (table test-table [id=5eb73258abbd4bcf92d6318c26db3fd6]) successfully deleted
I20260806 11:46:36.073529 29074 tablet_service.cc:1467] Processing CreateTablet for tablet 71d3df70ed404b13846ccbbb8d7ede7a (DEFAULT_TABLE table=test-table [id=e44a0de53823479a9e7be0127c8284f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:36.073796 29454 tablet_service.cc:1467] Processing CreateTablet for tablet 71d3df70ed404b13846ccbbb8d7ede7a (DEFAULT_TABLE table=test-table [id=e44a0de53823479a9e7be0127c8284f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:36.073887 29074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71d3df70ed404b13846ccbbb8d7ede7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:36.075862 29454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71d3df70ed404b13846ccbbb8d7ede7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:36.073129 29273 tablet_service.cc:1467] Processing CreateTablet for tablet 71d3df70ed404b13846ccbbb8d7ede7a (DEFAULT_TABLE table=test-table [id=e44a0de53823479a9e7be0127c8284f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:36.077333 29273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71d3df70ed404b13846ccbbb8d7ede7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:36.078935 29629 ts_tablet_manager.cc:1918] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:46:36.079200 29629 log.cc:1196] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/8daf337d05ff47b494f153b1f4fdf737
I20260806 11:46:36.079730 29629 ts_tablet_manager.cc:1939] T 8daf337d05ff47b494f153b1f4fdf737 P 82c2a9a6808d405d8f7e89feb9ac88e9: Deleting consensus metadata
I20260806 11:46:36.080065 29594 tablet_bootstrap.cc:492] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: Bootstrap starting.
I20260806 11:46:36.081781 29594 tablet_bootstrap.cc:654] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:36.081904 28851 catalog_manager.cc:4841] TS 82c2a9a6808d405d8f7e89feb9ac88e9 (127.26.172.194:39325): tablet 8daf337d05ff47b494f153b1f4fdf737 (table test-table [id=5eb73258abbd4bcf92d6318c26db3fd6]) successfully deleted
I20260806 11:46:36.083387 29628 ts_tablet_manager.cc:1918] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:46:36.083636 29628 log.cc:1196] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/8daf337d05ff47b494f153b1f4fdf737
I20260806 11:46:36.084131 29628 ts_tablet_manager.cc:1939] T 8daf337d05ff47b494f153b1f4fdf737 P 2611d4383bef4ba3b6f3639e7314a0f7: Deleting consensus metadata
I20260806 11:46:36.084167 29594 tablet_bootstrap.cc:492] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: No bootstrap required, opened a new log
I20260806 11:46:36.084338 29594 ts_tablet_manager.cc:1397] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260806 11:46:36.084674 29595 tablet_bootstrap.cc:492] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: Bootstrap starting.
I20260806 11:46:36.084970 29596 tablet_bootstrap.cc:492] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9: Bootstrap starting.
I20260806 11:46:36.084987 29594 raft_consensus.cc:348] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.085119 29594 raft_consensus.cc:374] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:36.085150 29594 raft_consensus.cc:729] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2611d4383bef4ba3b6f3639e7314a0f7, State: Initialized, Role: FOLLOWER
I20260806 11:46:36.085287 29594 consensus_queue.cc:260] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.085796 29594 ts_tablet_manager.cc:1428] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 11:46:36.086133 29595 tablet_bootstrap.cc:654] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:36.086514 29596 tablet_bootstrap.cc:654] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:36.089218 28849 catalog_manager.cc:4841] TS 2611d4383bef4ba3b6f3639e7314a0f7 (127.26.172.195:42847): tablet 8daf337d05ff47b494f153b1f4fdf737 (table test-table [id=5eb73258abbd4bcf92d6318c26db3fd6]) successfully deleted
I20260806 11:46:36.089102 29595 tablet_bootstrap.cc:492] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: No bootstrap required, opened a new log
I20260806 11:46:36.089557 29595 ts_tablet_manager.cc:1397] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260806 11:46:36.090306 29596 tablet_bootstrap.cc:492] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9: No bootstrap required, opened a new log
I20260806 11:46:36.090224 29595 raft_consensus.cc:348] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.090371 29595 raft_consensus.cc:374] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:36.090408 29595 raft_consensus.cc:729] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37668ab4de614003b3c5e2f20a840896, State: Initialized, Role: FOLLOWER
I20260806 11:46:36.090418 29596 ts_tablet_manager.cc:1397] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260806 11:46:36.090587 29595 consensus_queue.cc:260] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.091104 29595 ts_tablet_manager.cc:1428] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260806 11:46:36.091038 29596 raft_consensus.cc:348] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.091166 29596 raft_consensus.cc:374] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:36.091204 29596 raft_consensus.cc:729] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82c2a9a6808d405d8f7e89feb9ac88e9, State: Initialized, Role: FOLLOWER
I20260806 11:46:36.091361 29596 consensus_queue.cc:260] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.091719 29596 ts_tablet_manager.cc:1428] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260806 11:46:36.154224 29175 tablet.cc:2369] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:46:36.290288 29559 tablet.cc:2369] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:46:36.335949 29602 raft_consensus.cc:482] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:36.336180 29602 raft_consensus.cc:504] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.337718 29602 leader_election.cc:288] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82c2a9a6808d405d8f7e89feb9ac88e9 (127.26.172.194:39325), 2611d4383bef4ba3b6f3639e7314a0f7 (127.26.172.195:42847)
I20260806 11:46:36.344327 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.338475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:37255 (local address 127.26.172.194:39325)
0806 11:46:36.338672 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.338679 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.339106 (+ 427us) server_negotiation.cc:407] Connection header received
0806 11:46:36.339338 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.339341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.339441 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.339538 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:36.340035 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.340722 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.342963 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.343454 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.343620 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.343693 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.344059 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.344171 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260806 11:46:36.344650 29636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.338239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:39325 (local address 127.26.172.193:37255)
0806 11:46:36.338963 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:36.338981 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:36.339193 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:36.339560 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:36.339563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:36.339591 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:36.339733 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.339739 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.340993 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.340998 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.342699 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.342718 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.343620 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.343624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.343747 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.343781 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 11:46:36.344025 (+ 244us) client_negotiation.cc:240] Negotiation successful
0806 11:46:36.344146 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":129,"thread_start_us":181,"threads_started":1}
I20260806 11:46:36.345820 29591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.338498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:42359 (local address 127.26.172.195:42847)
0806 11:46:36.338672 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.338679 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.339288 (+ 609us) server_negotiation.cc:407] Connection header received
0806 11:46:36.339588 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.339592 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.339665 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.339765 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:36.340153 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.340774 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.342767 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.343880 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.344593 (+ 713us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.344852 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.345443 (+ 591us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.345607 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 11:46:36.346446 29635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.338239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:42847 (local address 127.26.172.193:42359)
0806 11:46:36.339139 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:36.339156 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:36.339346 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:36.339802 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:36.339805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:36.339824 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:36.339973 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.339979 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.340943 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.340949 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.342546 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.342566 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.345018 (+ 2452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.345028 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.345202 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.345245 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 11:46:36.346082 (+ 837us) client_negotiation.cc:240] Negotiation successful
0806 11:46:36.346214 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"mutex_wait_us":261,"thread_start_us":203,"threads_started":1}
I20260806 11:46:36.346670 29301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71d3df70ed404b13846ccbbb8d7ede7a" candidate_uuid: "37668ab4de614003b3c5e2f20a840896" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" is_pre_election: true
I20260806 11:46:36.347119 29301 raft_consensus.cc:2454] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37668ab4de614003b3c5e2f20a840896 in term 0.
I20260806 11:46:36.347426 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71d3df70ed404b13846ccbbb8d7ede7a" candidate_uuid: "37668ab4de614003b3c5e2f20a840896" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" is_pre_election: true
I20260806 11:46:36.347757 29488 raft_consensus.cc:2454] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37668ab4de614003b3c5e2f20a840896 in term 0.
I20260806 11:46:36.348189 29013 leader_election.cc:302] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37668ab4de614003b3c5e2f20a840896, 82c2a9a6808d405d8f7e89feb9ac88e9; no voters:
I20260806 11:46:36.348683 29602 raft_consensus.cc:2781] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:36.348773 29602 raft_consensus.cc:482] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:36.348821 29602 raft_consensus.cc:3037] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:36.350203 29602 raft_consensus.cc:504] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.350739 29602 leader_election.cc:288] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [CANDIDATE]: Term 1 election: Requested vote from peers 82c2a9a6808d405d8f7e89feb9ac88e9 (127.26.172.194:39325), 2611d4383bef4ba3b6f3639e7314a0f7 (127.26.172.195:42847)
I20260806 11:46:36.351472 29488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71d3df70ed404b13846ccbbb8d7ede7a" candidate_uuid: "37668ab4de614003b3c5e2f20a840896" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2611d4383bef4ba3b6f3639e7314a0f7"
I20260806 11:46:36.351655 29488 raft_consensus.cc:3037] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:36.351538 29301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71d3df70ed404b13846ccbbb8d7ede7a" candidate_uuid: "37668ab4de614003b3c5e2f20a840896" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9"
I20260806 11:46:36.351914 29301 raft_consensus.cc:3037] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:36.353000 29488 raft_consensus.cc:2454] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37668ab4de614003b3c5e2f20a840896 in term 1.
I20260806 11:46:36.353600 29008 leader_election.cc:302] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2611d4383bef4ba3b6f3639e7314a0f7, 37668ab4de614003b3c5e2f20a840896; no voters:
I20260806 11:46:36.353899 29602 raft_consensus.cc:2781] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:36.354252 29602 raft_consensus.cc:686] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 1 LEADER]: Becoming Leader. State: Replica: 37668ab4de614003b3c5e2f20a840896, State: Running, Role: LEADER
I20260806 11:46:36.353598 29301 raft_consensus.cc:2454] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37668ab4de614003b3c5e2f20a840896 in term 1.
I20260806 11:46:36.354687 29602 consensus_queue.cc:237] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.358115 28871 catalog_manager.cc:5495] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37668ab4de614003b3c5e2f20a840896 (127.26.172.193). New cstate: current_term: 1 leader_uuid: "37668ab4de614003b3c5e2f20a840896" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } health_report { overall_health: UNKNOWN } } }
Aug 06 11:46:36 dist-test-slave-7z32 krb5kdc[28813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016794, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:36.436828 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.422421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33227 (local address 127.0.0.1:44750)
0806 11:46:36.423224 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:36.423241 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:36.423491 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:36.424012 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:36.424024 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:36.424627 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:36.424780 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.424788 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.425666 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.425669 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.426268 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.426282 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.427228 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.427232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.427411 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.428533 (+ 1122us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:36.428556 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:36.430737 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:36.433962 (+ 3225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:36.434073 (+ 111us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:36.434084 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:36.434572 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:36.435208 (+ 636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:36.435212 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:36.435214 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:36.435332 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:36.436090 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:36.436099 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:36.436284 (+ 185us) client_negotiation.cc:769] Sending connection context
0806 11:46:36.436413 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 11:46:36.436628 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":533,"threads_started":1}
I20260806 11:46:36.437175 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.422623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44750 (local address 127.26.172.254:33227)
0806 11:46:36.423342 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.423354 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.423385 (+ 31us) server_negotiation.cc:407] Connection header received
0806 11:46:36.423673 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.423676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.423752 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.423890 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:36.424950 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.425530 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.426479 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.427027 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.427213 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.431167 (+ 3954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:36.431173 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:36.431178 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:36.431221 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:36.433562 (+ 2341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:36.434787 (+ 1225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:36.434793 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:36.434794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:36.435045 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:36.435547 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:36.435550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:36.435552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:36.435912 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:36.436035 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.436551 (+ 516us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.436734 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":384,"threads_started":1}
I20260806 11:46:36.444007 28871 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:44750:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 11:46:36.445353 28871 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:36.453460 29454 tablet_service.cc:1467] Processing CreateTablet for tablet cfe383597a6a45999209dd1445bf4f36 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=29cf120aa5a94493b7dc8b75c81bee67]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 11:46:36.453483 29074 tablet_service.cc:1467] Processing CreateTablet for tablet cfe383597a6a45999209dd1445bf4f36 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=29cf120aa5a94493b7dc8b75c81bee67]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 11:46:36.453483 29273 tablet_service.cc:1467] Processing CreateTablet for tablet cfe383597a6a45999209dd1445bf4f36 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=29cf120aa5a94493b7dc8b75c81bee67]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 11:46:36.453989 29454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe383597a6a45999209dd1445bf4f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:36.454118 29273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe383597a6a45999209dd1445bf4f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:36.454118 29074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe383597a6a45999209dd1445bf4f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:36.458009 29594 tablet_bootstrap.cc:492] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: Bootstrap starting.
I20260806 11:46:36.458182 29596 tablet_bootstrap.cc:492] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: Bootstrap starting.
I20260806 11:46:36.458182 29595 tablet_bootstrap.cc:492] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: Bootstrap starting.
I20260806 11:46:36.459348 29594 tablet_bootstrap.cc:654] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:36.459574 29596 tablet_bootstrap.cc:654] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:36.459619 29595 tablet_bootstrap.cc:654] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:36.461771 29595 tablet_bootstrap.cc:492] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: No bootstrap required, opened a new log
I20260806 11:46:36.461833 29596 tablet_bootstrap.cc:492] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: No bootstrap required, opened a new log
I20260806 11:46:36.461930 29595 ts_tablet_manager.cc:1397] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260806 11:46:36.461952 29596 ts_tablet_manager.cc:1397] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260806 11:46:36.462193 29594 tablet_bootstrap.cc:492] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: No bootstrap required, opened a new log
I20260806 11:46:36.462360 29594 ts_tablet_manager.cc:1397] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 11:46:36.462512 29596 raft_consensus.cc:348] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.462512 29595 raft_consensus.cc:348] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.462670 29595 raft_consensus.cc:374] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:36.462670 29596 raft_consensus.cc:374] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:36.462719 29596 raft_consensus.cc:729] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82c2a9a6808d405d8f7e89feb9ac88e9, State: Initialized, Role: FOLLOWER
I20260806 11:46:36.462719 29595 raft_consensus.cc:729] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37668ab4de614003b3c5e2f20a840896, State: Initialized, Role: FOLLOWER
I20260806 11:46:36.462904 29596 consensus_queue.cc:260] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.462904 29595 consensus_queue.cc:260] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.463238 29596 ts_tablet_manager.cc:1428] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 11:46:36.463245 29595 ts_tablet_manager.cc:1428] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260806 11:46:36.463366 29602 tablet_replica.cc:439] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } } }
I20260806 11:46:36.463601 29602 tablet_replica.cc:442] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:36.463547 29601 tablet_replica.cc:439] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } } }
I20260806 11:46:36.463723 29601 tablet_replica.cc:442] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:36.463831 29594 raft_consensus.cc:348] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.464002 29594 raft_consensus.cc:374] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:36.464044 29594 raft_consensus.cc:729] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2611d4383bef4ba3b6f3639e7314a0f7, State: Initialized, Role: FOLLOWER
I20260806 11:46:36.464195 29594 consensus_queue.cc:260] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.464551 29594 ts_tablet_manager.cc:1428] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 11:46:36.465456 29600 tablet_replica.cc:439] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } } }
I20260806 11:46:36.465664 29600 tablet_replica.cc:442] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:36.598512 29600 raft_consensus.cc:482] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:36.598713 29600 raft_consensus.cc:504] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.600203 29600 leader_election.cc:288] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37668ab4de614003b3c5e2f20a840896 (127.26.172.193:36693), 82c2a9a6808d405d8f7e89feb9ac88e9 (127.26.172.194:39325)
I20260806 11:46:36.605248 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.600777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:42601 (local address 127.26.172.193:36693)
0806 11:46:36.601480 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.601484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.601498 (+ 14us) server_negotiation.cc:407] Connection header received
0806 11:46:36.601592 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.601595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.601659 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.601776 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:36.602123 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.602697 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.604092 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.604564 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.604717 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.604793 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.604998 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.605085 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":175,"threads_started":1}
I20260806 11:46:36.605257 29657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.600472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:36693 (local address 127.26.172.195:42601)
0806 11:46:36.600768 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:36.600787 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:36.600921 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:36.601798 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:36.601802 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:36.601827 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:36.601978 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.601986 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.602861 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.602866 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.603949 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.603960 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.604717 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.604721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.604844 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.604879 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 11:46:36.604977 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 11:46:36.605075 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":38,"thread_start_us":130,"threads_started":1}
I20260806 11:46:36.606274 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.601181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:49581 (local address 127.26.172.194:39325)
0806 11:46:36.601345 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.601352 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.601582 (+ 230us) server_negotiation.cc:407] Connection header received
0806 11:46:36.601918 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.601922 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.601982 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.602112 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:36.602783 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.603434 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.604637 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.605256 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.605498 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.605603 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.606027 (+ 424us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.606154 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 11:46:36.606128 29111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe383597a6a45999209dd1445bf4f36" candidate_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37668ab4de614003b3c5e2f20a840896" is_pre_election: true
I20260806 11:46:36.606524 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.600938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:39325 (local address 127.26.172.195:49581)
0806 11:46:36.601374 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:36.601392 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:36.601694 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:36.602148 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:36.602152 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:36.602215 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:36.602599 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.602610 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.603599 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.603604 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.604468 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.604480 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.605662 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.605666 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.605832 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.605863 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 11:46:36.606066 (+ 203us) client_negotiation.cc:240] Negotiation successful
0806 11:46:36.606322 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":5,"thread_start_us":64,"threads_started":1}
I20260806 11:46:36.606509 29111 raft_consensus.cc:2454] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2611d4383bef4ba3b6f3639e7314a0f7 in term 0.
I20260806 11:46:36.607129 29401 leader_election.cc:302] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2611d4383bef4ba3b6f3639e7314a0f7, 37668ab4de614003b3c5e2f20a840896; no voters:
I20260806 11:46:36.607267 29301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe383597a6a45999209dd1445bf4f36" candidate_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" is_pre_election: true
I20260806 11:46:36.607514 29301 raft_consensus.cc:2454] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2611d4383bef4ba3b6f3639e7314a0f7 in term 0.
I20260806 11:46:36.607558 29600 raft_consensus.cc:2781] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:36.607622 29600 raft_consensus.cc:482] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:36.607676 29600 raft_consensus.cc:3037] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:36.609054 29600 raft_consensus.cc:504] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.609527 29600 leader_election.cc:288] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [CANDIDATE]: Term 1 election: Requested vote from peers 37668ab4de614003b3c5e2f20a840896 (127.26.172.193:36693), 82c2a9a6808d405d8f7e89feb9ac88e9 (127.26.172.194:39325)
I20260806 11:46:36.610203 29301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe383597a6a45999209dd1445bf4f36" candidate_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9"
I20260806 11:46:36.610203 29111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe383597a6a45999209dd1445bf4f36" candidate_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37668ab4de614003b3c5e2f20a840896"
I20260806 11:46:36.610441 29301 raft_consensus.cc:3037] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:36.610441 29111 raft_consensus.cc:3037] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:36.611840 29301 raft_consensus.cc:2454] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2611d4383bef4ba3b6f3639e7314a0f7 in term 1.
I20260806 11:46:36.611881 29111 raft_consensus.cc:2454] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2611d4383bef4ba3b6f3639e7314a0f7 in term 1.
I20260806 11:46:36.612383 29401 leader_election.cc:302] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2611d4383bef4ba3b6f3639e7314a0f7, 37668ab4de614003b3c5e2f20a840896; no voters:
I20260806 11:46:36.612615 29600 raft_consensus.cc:2781] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:36.612864 29600 raft_consensus.cc:686] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 LEADER]: Becoming Leader. State: Replica: 2611d4383bef4ba3b6f3639e7314a0f7, State: Running, Role: LEADER
I20260806 11:46:36.613186 29600 consensus_queue.cc:237] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } }
I20260806 11:46:36.615101 29663 tablet_replica.cc:439] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: TxnStatusTablet state changed. Reason: New leader 2611d4383bef4ba3b6f3639e7314a0f7. Latest consensus state: current_term: 1 leader_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } } }
I20260806 11:46:36.615316 29663 tablet_replica.cc:442] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: This TxnStatusTablet replica's current role is: LEADER
I20260806 11:46:36.616159 29665 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 11:46:36.616451 29665 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 11:46:36.617493 28873 catalog_manager.cc:5495] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2611d4383bef4ba3b6f3639e7314a0f7 (127.26.172.195). New cstate: current_term: 1 leader_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } health_report { overall_health: HEALTHY } } }
I20260806 11:46:36.671532 29591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.666672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46712 (local address 127.26.172.195:42847)
0806 11:46:36.666863 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.666869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.667011 (+ 142us) server_negotiation.cc:407] Connection header received
0806 11:46:36.667399 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.667403 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.667477 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.667612 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:36.667928 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.668516 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.669751 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.670002 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.670128 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.670491 (+ 363us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:36.671083 (+ 592us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:36.671223 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.671300 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.671365 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 11:46:36.671532 29651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.666493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:42847 (local address 127.0.0.1:46712)
0806 11:46:36.666791 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:36.666812 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:36.667128 (+ 316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:36.667636 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:36.667640 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:36.667649 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:46:36.667783 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.667789 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.668654 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.668659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.669593 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.669607 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.670141 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.670144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.670243 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.670303 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:46:36.671194 (+ 891us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:46:36.671213 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 11:46:36.671288 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 11:46:36.671401 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260806 11:46:36.677052 29111 raft_consensus.cc:1261] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896 [term 1 FOLLOWER]: Refusing update from remote peer 2611d4383bef4ba3b6f3639e7314a0f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:36.677335 29301 raft_consensus.cc:1261] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 FOLLOWER]: Refusing update from remote peer 2611d4383bef4ba3b6f3639e7314a0f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:36.677697 29663 consensus_queue.cc:1035] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:36.678167 29600 consensus_queue.cc:1035] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:36.679955 29602 tablet_replica.cc:439] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: TxnStatusTablet state changed. Reason: New leader 2611d4383bef4ba3b6f3639e7314a0f7. Latest consensus state: current_term: 1 leader_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } } }
I20260806 11:46:36.680104 29602 tablet_replica.cc:442] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:36.682174 29601 tablet_replica.cc:439] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: TxnStatusTablet state changed. Reason: New leader 2611d4383bef4ba3b6f3639e7314a0f7. Latest consensus state: current_term: 1 leader_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } } }
I20260806 11:46:36.682348 29601 tablet_replica.cc:442] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:36.683568 29672 mvcc.cc:205] Tried to move back new op lower bound from 7315524799181066240 to 7315524798930542592. Current Snapshot: MvccSnapshot[applied={T|T < 7315524799181066240}]
I20260806 11:46:36.683248 29600 tablet_replica.cc:439] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } } }
I20260806 11:46:36.683749 29600 tablet_replica.cc:442] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: This TxnStatusTablet replica's current role is: LEADER
I20260806 11:46:36.683818 29602 tablet_replica.cc:439] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } } }
I20260806 11:46:36.683944 29602 tablet_replica.cc:442] T cfe383597a6a45999209dd1445bf4f36 P 37668ab4de614003b3c5e2f20a840896: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:36.684476 29671 mvcc.cc:205] Tried to move back new op lower bound from 7315524799181066240 to 7315524798930542592. Current Snapshot: MvccSnapshot[applied={T|T < 7315524799181066240}]
I20260806 11:46:36.686388 29663 tablet_replica.cc:439] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } } }
I20260806 11:46:36.686554 29663 tablet_replica.cc:442] T cfe383597a6a45999209dd1445bf4f36 P 2611d4383bef4ba3b6f3639e7314a0f7: This TxnStatusTablet replica's current role is: LEADER
I20260806 11:46:36.688390 29601 tablet_replica.cc:439] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37668ab4de614003b3c5e2f20a840896" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36693 } } peers { permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 } } peers { permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 } } }
I20260806 11:46:36.688575 29601 tablet_replica.cc:442] T cfe383597a6a45999209dd1445bf4f36 P 82c2a9a6808d405d8f7e89feb9ac88e9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:36.689425 29674 mvcc.cc:205] Tried to move back new op lower bound from 7315524799181066240 to 7315524798930542592. Current Snapshot: MvccSnapshot[applied={T|T < 7315524799181066240}]
I20260806 11:46:36.701653 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.695325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38160 (local address 127.26.172.193:36693)
0806 11:46:36.695505 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.695512 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.695777 (+ 265us) server_negotiation.cc:407] Connection header received
0806 11:46:36.695992 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.695995 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.696240 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.696405 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:36.696788 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.697360 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.698880 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.699353 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.699689 (+ 336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.699999 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:36.700991 (+ 992us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:36.701175 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.701330 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.701441 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 11:46:36.720542 29591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.715048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:36335 (local address 127.26.172.195:42847)
0806 11:46:36.715267 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.715274 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.715851 (+ 577us) server_negotiation.cc:407] Connection header received
0806 11:46:36.716132 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.716135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.716196 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.716305 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:36.716732 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.717291 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.718964 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.719240 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.719362 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.719935 (+ 573us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:36.720085 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:36.720163 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.720333 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.720407 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 11:46:36.720678 29684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.714893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:42847 (local address 127.26.172.193:36335)
0806 11:46:36.715623 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:36.715647 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:36.715933 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:36.716370 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:36.716374 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:36.716385 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:46:36.716586 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.716593 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.717430 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.717434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.718668 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.718685 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.719412 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.719417 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.719541 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.719679 (+ 138us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:46:36.720200 (+ 521us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:46:36.720210 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 11:46:36.720303 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 11:46:36.720427 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":236,"threads_started":1}
I20260806 11:46:36.731767 29488 raft_consensus.cc:1261] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 FOLLOWER]: Refusing update from remote peer 37668ab4de614003b3c5e2f20a840896: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:36.731856 29301 raft_consensus.cc:1261] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 FOLLOWER]: Refusing update from remote peer 37668ab4de614003b3c5e2f20a840896: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:36.732452 29602 consensus_queue.cc:1035] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2611d4383bef4ba3b6f3639e7314a0f7" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:36.732867 29637 consensus_queue.cc:1035] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82c2a9a6808d405d8f7e89feb9ac88e9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:36.773056 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.768545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:53201 (local address 127.26.172.193:36693)
0806 11:46:36.768802 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.768809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.768841 (+ 32us) server_negotiation.cc:407] Connection header received
0806 11:46:36.768938 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.768944 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.769039 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.769188 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:36.769628 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.770448 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.771651 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.771917 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.772061 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.772419 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:36.772517 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:36.772637 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.772788 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.772866 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 11:46:36.773803 29690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.768123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:36693 (local address 127.26.172.195:53201)
0806 11:46:36.768565 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:36.768587 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:36.768710 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:36.769214 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:36.769219 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:36.769229 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:46:36.769429 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.769438 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.770658 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.770661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.771508 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:36.771519 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.772062 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.772066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:36.772178 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.772243 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:46:36.772654 (+ 411us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:46:36.772662 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 11:46:36.773464 (+ 802us) client_negotiation.cc:240] Negotiation successful
0806 11:46:36.773597 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":176,"threads_started":1}
I20260806 11:46:36.815294 28873 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:36.815555 28873 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44744:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:36.819162 28873 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be4cb336344d442c9c31635e7814a51c: Sending DeleteTablet for 3 replicas of tablet 71d3df70ed404b13846ccbbb8d7ede7a
I20260806 11:46:36.820389 29273 tablet_service.cc:1514] Processing DeleteTablet for tablet 71d3df70ed404b13846ccbbb8d7ede7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:36 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:57534
I20260806 11:46:36.820433 29074 tablet_service.cc:1514] Processing DeleteTablet for tablet 71d3df70ed404b13846ccbbb8d7ede7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:36 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:38148
I20260806 11:46:36.820434 29454 tablet_service.cc:1514] Processing DeleteTablet for tablet 71d3df70ed404b13846ccbbb8d7ede7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:36 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:46696
I20260806 11:46:36.821600 29699 tablet_replica.cc:330] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9: stopping tablet replica
I20260806 11:46:36.821866 29699 raft_consensus.cc:2229] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:36.822180 29699 raft_consensus.cc:2258] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:36.823338 29699 ts_tablet_manager.cc:1905] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:36.826632 29699 ts_tablet_manager.cc:1918] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:46:36.826769 29699 log.cc:1196] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/71d3df70ed404b13846ccbbb8d7ede7a
I20260806 11:46:36.827134 29699 ts_tablet_manager.cc:1939] T 71d3df70ed404b13846ccbbb8d7ede7a P 82c2a9a6808d405d8f7e89feb9ac88e9: Deleting consensus metadata
I20260806 11:46:36.827150 29700 tablet_replica.cc:330] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: stopping tablet replica
I20260806 11:46:36.827379 29700 raft_consensus.cc:2229] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:46:36.828248 28851 catalog_manager.cc:4841] TS 82c2a9a6808d405d8f7e89feb9ac88e9 (127.26.172.194:39325): tablet 71d3df70ed404b13846ccbbb8d7ede7a (table test-table [id=e44a0de53823479a9e7be0127c8284f9]) successfully deleted
I20260806 11:46:36.828327 29700 raft_consensus.cc:2258] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:36.829324 29700 ts_tablet_manager.cc:1905] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:36.832759 29702 tablet_replica.cc:330] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: stopping tablet replica
I20260806 11:46:36.833770 29702 raft_consensus.cc:2229] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:36.833882 29700 ts_tablet_manager.cc:1918] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:46:36.834024 29700 log.cc:1196] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/71d3df70ed404b13846ccbbb8d7ede7a
I20260806 11:46:36.834254 29702 raft_consensus.cc:2258] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:36.834362 29700 ts_tablet_manager.cc:1939] T 71d3df70ed404b13846ccbbb8d7ede7a P 37668ab4de614003b3c5e2f20a840896: Deleting consensus metadata
I20260806 11:46:36.835536 28851 catalog_manager.cc:4841] TS 37668ab4de614003b3c5e2f20a840896 (127.26.172.193:36693): tablet 71d3df70ed404b13846ccbbb8d7ede7a (table test-table [id=e44a0de53823479a9e7be0127c8284f9]) successfully deleted
I20260806 11:46:36.836076 29702 ts_tablet_manager.cc:1905] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:36.840147 29702 ts_tablet_manager.cc:1918] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:46:36.840286 29702 log.cc:1196] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/71d3df70ed404b13846ccbbb8d7ede7a
I20260806 11:46:36.840623 29702 ts_tablet_manager.cc:1939] T 71d3df70ed404b13846ccbbb8d7ede7a P 2611d4383bef4ba3b6f3639e7314a0f7: Deleting consensus metadata
I20260806 11:46:36.841717 28849 catalog_manager.cc:4841] TS 2611d4383bef4ba3b6f3639e7314a0f7 (127.26.172.195:42847): tablet 71d3df70ed404b13846ccbbb8d7ede7a (table test-table [id=e44a0de53823479a9e7be0127c8284f9]) successfully deleted
Aug 06 11:46:36 dist-test-slave-7z32 krb5kdc[28813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016795, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:46:36.850939 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.827836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38176 (local address 127.26.172.193:36693)
0806 11:46:36.827995 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.828001 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.828847 (+ 846us) server_negotiation.cc:407] Connection header received
0806 11:46:36.829032 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.829037 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.829114 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.829199 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:36.830547 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.831431 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.832793 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.833363 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.833486 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.844584 (+ 11098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:36.844606 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:36.844632 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:36.844684 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:36.847580 (+ 2896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:36.848484 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:36.848492 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:36.848494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:36.848640 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:36.849262 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:36.849269 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:36.849272 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:36.849759 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:36.850049 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.850458 (+ 409us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.850657 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260806 11:46:36.852226 29165 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38176
I20260806 11:46:36.867420 29652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:36.855071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44756 (local address 127.26.172.254:33227)
0806 11:46:36.855271 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:36.855276 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:36.855716 (+ 440us) server_negotiation.cc:407] Connection header received
0806 11:46:36.856199 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:36.856204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:36.856279 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:36.856387 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:36.857781 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.858401 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.859889 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:36.860196 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:36.860325 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:36.862665 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:36.862669 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:36.862672 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:36.862709 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:36.864879 (+ 2170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:36.865644 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:36.865648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:36.865649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:36.865760 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:36.866158 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:36.866161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:36.866163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:36.866427 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:36.866568 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:36.867057 (+ 489us) server_negotiation.cc:299] Negotiation successful
0806 11:46:36.867219 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 11:46:36.867990 28873 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44756
I20260806 11:46:36.869928 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 28988
I20260806 11:46:36.905632 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 29189
I20260806 11:46:36.929845 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 29376
I20260806 11:46:36.950575 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 28829
2026-08-06T11:46:36Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3945 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:46:37 dist-test-slave-7z32 krb5kdc[29710](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:46:37 dist-test-slave-7z32 krb5kdc[29710](info): set up 2 sockets
Aug 06 11:46:37 dist-test-slave-7z32 krb5kdc[29710](info): commencing operation
krb5kdc: starting...
W20260806 11:46:38.275430 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:46:38 dist-test-slave-7z32 krb5kdc[29710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:46:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:46:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:46:38.456525 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:33351
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:33351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:38.587030 29735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:38.587381 29735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:38.587430 29735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:38.591750 29735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:46:38.591848 29735 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 11:46:38.591867 29735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:38.591886 29735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:38.591903 29735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:46:38.591919 29735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:46:38.597777 29735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:33351
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:33351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:38.599162 29735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:38.600436 29735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 11:46:38.613444 29735 server_base.cc:1034] running on GCE node
W20260806 11:46:38.613305 29746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:38.613305 29744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:38.613639 29743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:38.614701 29735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:38.616189 29735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:38.617733 29735 hybrid_clock.cc:648] HybridClock initialized: now 1786016798617667 us; error 93 us; skew 500 ppm
Aug 06 11:46:38 dist-test-slave-7z32 krb5kdc[29710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016798, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:38.622009 29735 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:46:38.623373 29735 webserver.cc:460] Webserver started at http://127.26.172.254:46321/ using document root <none> and password file <none>
I20260806 11:46:38.624080 29735 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:38.624190 29735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:38.624473 29735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:38.627014 29735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "820c1e7c292d4df68f3993af23614106"
format_stamp: "Formatted at 2026-08-06 11:46:38 on dist-test-slave-7z32"
server_key: "5bac29b28c22c26caab97ed99a86e479"
server_key_iv: "20fe3480ba14f04ad6454fa761d11ce8"
server_key_version: "encryptionkey@0"
I20260806 11:46:38.627744 29735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "820c1e7c292d4df68f3993af23614106"
format_stamp: "Formatted at 2026-08-06 11:46:38 on dist-test-slave-7z32"
server_key: "5bac29b28c22c26caab97ed99a86e479"
server_key_iv: "20fe3480ba14f04ad6454fa761d11ce8"
server_key_version: "encryptionkey@0"
I20260806 11:46:38.633019 29735 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:46:38.637068 29756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:38.639916 29735 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260806 11:46:38.640215 29735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "820c1e7c292d4df68f3993af23614106"
format_stamp: "Formatted at 2026-08-06 11:46:38 on dist-test-slave-7z32"
server_key: "5bac29b28c22c26caab97ed99a86e479"
server_key_iv: "20fe3480ba14f04ad6454fa761d11ce8"
server_key_version: "encryptionkey@0"
I20260806 11:46:38.640394 29735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:38.653079 29735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:38.658120 29735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:38.658483 29735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:38.669698 29735 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:33351
I20260806 11:46:38.669832 29845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:33351 every 8 connection(s)
I20260806 11:46:38.671271 29735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:46:38.676098 29847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:38.678530 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 29735
I20260806 11:46:38.678727 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:46:38.679123 27315 external_mini_cluster.cc:1428] Setting key 71860398a608e846809354f3b0acce53
I20260806 11:46:38.686146 29847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106: Bootstrap starting.
I20260806 11:46:38.690730 29847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:38.692205 29847 log.cc:824] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106: Log is configured to *not* fsync() on all Append() calls
Aug 06 11:46:38 dist-test-slave-7z32 krb5kdc[29710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:38.697149 29847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106: No bootstrap required, opened a new log
I20260806 11:46:38.702044 29847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "820c1e7c292d4df68f3993af23614106" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33351 } }
I20260806 11:46:38.702521 29847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:38.702637 29847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 820c1e7c292d4df68f3993af23614106, State: Initialized, Role: FOLLOWER
I20260806 11:46:38.703104 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:38.681547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57662 (local address 127.26.172.254:33351)
0806 11:46:38.682444 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:38.682469 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:38.682526 (+ 57us) server_negotiation.cc:407] Connection header received
0806 11:46:38.683563 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:38.683591 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:38.684060 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:38.684497 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:38.685525 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:38.686735 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:38.688881 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:38.690289 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:38.690637 (+ 348us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:38.695222 (+ 4585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:38.695230 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:38.695255 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:38.695300 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:38.698416 (+ 3116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:38.699181 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:38.699188 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:38.699194 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:38.699350 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:38.699694 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:38.699698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:38.699700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:38.700258 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:38.700565 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:38.701135 (+ 570us) server_negotiation.cc:299] Negotiation successful
0806 11:46:38.701779 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":367,"threads_started":1}
I20260806 11:46:38.703464 29847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "820c1e7c292d4df68f3993af23614106" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33351 } }
I20260806 11:46:38.703723 29847 raft_consensus.cc:388] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:46:38.703838 29847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:46:38.704006 29847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:38.706214 29847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "820c1e7c292d4df68f3993af23614106" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33351 } }
I20260806 11:46:38.706794 29847 leader_election.cc:302] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 820c1e7c292d4df68f3993af23614106; no voters:
I20260806 11:46:38.707376 29847 leader_election.cc:288] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:46:38.707561 29853 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:38.707939 29853 raft_consensus.cc:686] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [term 1 LEADER]: Becoming Leader. State: Replica: 820c1e7c292d4df68f3993af23614106, State: Running, Role: LEADER
I20260806 11:46:38.708377 29853 consensus_queue.cc:237] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "820c1e7c292d4df68f3993af23614106" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33351 } }
I20260806 11:46:38.709367 29847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:46:38.710999 29854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "820c1e7c292d4df68f3993af23614106" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "820c1e7c292d4df68f3993af23614106" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33351 } } }
I20260806 11:46:38.711200 29854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:38.711675 29855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 820c1e7c292d4df68f3993af23614106. Latest consensus state: current_term: 1 leader_uuid: "820c1e7c292d4df68f3993af23614106" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "820c1e7c292d4df68f3993af23614106" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33351 } } }
I20260806 11:46:38.711802 29862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:46:38.711823 29855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:38.716142 29862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:46:38.725102 29862 catalog_manager.cc:1347] Generated new cluster ID: dc8c4ce01a9d489c8422849b6695ea28
I20260806 11:46:38.725241 29862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:46:38.743256 29862 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:46:38.744609 29862 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:46:38.750905 29862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106: Generated new TSK 0
I20260806 11:46:38.752265 29862 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:46:38.807991 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33351
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:38.941385 29883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:38.941789 29883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:38.941881 29883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:38.946449 29883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:38.946563 29883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:38.946640 29883 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 11:46:38.946686 29883 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 11:46:38.946759 29883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:46:38.952536 29883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.172.254:33351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:38.953895 29883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:38.955107 29883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:38.967255 29897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:38.967206 29894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:38.967589 29883 server_base.cc:1034] running on GCE node
W20260806 11:46:38.967198 29892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:38.968909 29883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:38.970242 29883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:38.971526 29883 hybrid_clock.cc:648] HybridClock initialized: now 1786016798971460 us; error 89 us; skew 500 ppm
Aug 06 11:46:38 dist-test-slave-7z32 krb5kdc[29710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016798, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:38.976362 29883 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:46:38.977921 29883 webserver.cc:460] Webserver started at http://127.26.172.193:41103/ using document root <none> and password file <none>
I20260806 11:46:38.978936 29883 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:38.979055 29883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:38.979333 29883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:38.982419 29883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "0e69c604312c44938c616a3b51fef24a"
format_stamp: "Formatted at 2026-08-06 11:46:38 on dist-test-slave-7z32"
server_key: "b8dd3565534d35dc8247644f469ac710"
server_key_iv: "551d9e0d33af2ec1252453ca3b6190a4"
server_key_version: "encryptionkey@0"
I20260806 11:46:38.983346 29883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "0e69c604312c44938c616a3b51fef24a"
format_stamp: "Formatted at 2026-08-06 11:46:38 on dist-test-slave-7z32"
server_key: "b8dd3565534d35dc8247644f469ac710"
server_key_iv: "551d9e0d33af2ec1252453ca3b6190a4"
server_key_version: "encryptionkey@0"
I20260806 11:46:38.989964 29883 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 11:46:38.994453 29904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:38.996937 29883 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:46:38.997241 29883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "0e69c604312c44938c616a3b51fef24a"
format_stamp: "Formatted at 2026-08-06 11:46:38 on dist-test-slave-7z32"
server_key: "b8dd3565534d35dc8247644f469ac710"
server_key_iv: "551d9e0d33af2ec1252453ca3b6190a4"
server_key_version: "encryptionkey@0"
I20260806 11:46:38.997475 29883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:39.068655 29883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:39.074151 29883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:39.074472 29883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:39.076351 29883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:39.076582 29883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:39.076862 29883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:39.076942 29883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 11:46:39 dist-test-slave-7z32 krb5kdc[29710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016798, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:39.095463 29883 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:42417
I20260806 11:46:39.095657 30058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:42417 every 8 connection(s)
I20260806 11:46:39.097157 29883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:46:39.099893 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.078086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:50385 (local address 127.26.172.254:33351)
0806 11:46:39.078232 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:39.078236 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:39.080603 (+ 2367us) server_negotiation.cc:407] Connection header received
0806 11:46:39.082047 (+ 1444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:39.082055 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:39.082157 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:39.082226 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:39.084671 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.085818 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.088930 (+ 3112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.089366 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.089569 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.094218 (+ 4649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:39.094222 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:39.094224 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:39.094259 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:39.096594 (+ 2335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.097530 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.097535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.097537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.097689 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.098226 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.098232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.098234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.098628 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:39.098735 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:39.099544 (+ 809us) server_negotiation.cc:299] Negotiation successful
0806 11:46:39.099723 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 11:46:39.100986 29917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.079464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33351 (local address 127.26.172.193:50385)
0806 11:46:39.080374 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:39.080435 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:39.081549 (+ 1114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:39.082781 (+ 1232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:39.082795 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:39.083464 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:39.084276 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.084301 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.086145 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.086153 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.088579 (+ 2426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.088613 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.089735 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.089744 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.090039 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.090954 (+ 915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:39.090978 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:39.093909 (+ 2931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:39.096833 (+ 2924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.096842 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.096868 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.097294 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.097829 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.097832 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.097834 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.098046 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.098783 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:39.098792 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:39.099214 (+ 422us) client_negotiation.cc:769] Sending connection context
0806 11:46:39.099421 (+ 207us) client_negotiation.cc:240] Negotiation successful
0806 11:46:39.099798 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"spinlock_wait_cycles":21376,"thread_start_us":417,"threads_started":1}
I20260806 11:46:39.102392 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 29883
I20260806 11:46:39.102556 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:46:39.102939 27315 external_mini_cluster.cc:1428] Setting key 92f71f4f79671ff6a86d4e656cb0ed3a
I20260806 11:46:39.103655 30059 heartbeater.cc:347] Connected to a master server at 127.26.172.254:33351
I20260806 11:46:39.103850 30059 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:39.104662 30059 heartbeater.cc:511] Master 127.26.172.254:33351 requested a full tablet report, sending...
I20260806 11:46:39.110173 29768 ts_manager.cc:194] Registered new tserver with Master: 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417)
I20260806 11:46:39.112030 29768 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:50385
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:46:39.119853 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.106275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:43393 (local address 127.26.172.254:33351)
0806 11:46:39.106450 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:39.106457 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:39.106616 (+ 159us) server_negotiation.cc:407] Connection header received
0806 11:46:39.106789 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:39.106796 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:39.106912 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:39.107043 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:39.107656 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.108574 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.109852 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.110352 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.110505 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.112617 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:39.112625 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:39.112632 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:39.112671 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:39.117084 (+ 4413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.118012 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.118018 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.118023 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.118140 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.118574 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.118578 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.118579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.118964 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:39.119087 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:39.119556 (+ 469us) server_negotiation.cc:299] Negotiation successful
0806 11:46:39.119699 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 11:46:39.119854 30065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.106135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33351 (local address 127.26.172.193:43393)
0806 11:46:39.106490 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:39.106507 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:39.106650 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:39.107120 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:39.107124 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:39.107382 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:39.107505 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.107511 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.108726 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.108731 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.109677 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.109693 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.110721 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.110729 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.110911 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.111728 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:39.111749 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:39.112349 (+ 600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:39.117325 (+ 4976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.117331 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.117333 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.117854 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.118299 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.118303 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.118305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.118416 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.119116 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:39.119122 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:39.119303 (+ 181us) client_negotiation.cc:769] Sending connection context
0806 11:46:39.119424 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 11:46:39.119621 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":127,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:46:39.149277 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33351
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:39.298926 30069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:39.299326 30069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:39.299382 30069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:39.303987 30069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:39.304142 30069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:39.304221 30069 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 11:46:39.304258 30069 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 11:46:39.304328 30069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:46:39.310784 30069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.172.254:33351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:39.312381 30069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:39.313637 30069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 11:46:39.328099 30069 server_base.cc:1034] running on GCE node
W20260806 11:46:39.327999 30079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:39.327997 30074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:39.327997 30075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:39.329154 30069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:39.330225 30069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:39.331477 30069 hybrid_clock.cc:648] HybridClock initialized: now 1786016799331404 us; error 103 us; skew 500 ppm
Aug 06 11:46:39 dist-test-slave-7z32 krb5kdc[29710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:39.335727 30069 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:46:39.337610 30069 webserver.cc:460] Webserver started at http://127.26.172.194:46431/ using document root <none> and password file <none>
I20260806 11:46:39.338558 30069 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:39.338698 30069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:39.339092 30069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:39.343282 30069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "f82f223f2ab8436b8c398ddfee40894e"
format_stamp: "Formatted at 2026-08-06 11:46:39 on dist-test-slave-7z32"
server_key: "352ac97bd3da9c4e3a392617a7eae7f7"
server_key_iv: "63276975614be3a354d1500d98fc3213"
server_key_version: "encryptionkey@0"
I20260806 11:46:39.344450 30069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "f82f223f2ab8436b8c398ddfee40894e"
format_stamp: "Formatted at 2026-08-06 11:46:39 on dist-test-slave-7z32"
server_key: "352ac97bd3da9c4e3a392617a7eae7f7"
server_key_iv: "63276975614be3a354d1500d98fc3213"
server_key_version: "encryptionkey@0"
I20260806 11:46:39.352087 30069 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260806 11:46:39.356655 30088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:39.359364 30069 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:46:39.359627 30069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "f82f223f2ab8436b8c398ddfee40894e"
format_stamp: "Formatted at 2026-08-06 11:46:39 on dist-test-slave-7z32"
server_key: "352ac97bd3da9c4e3a392617a7eae7f7"
server_key_iv: "63276975614be3a354d1500d98fc3213"
server_key_version: "encryptionkey@0"
I20260806 11:46:39.359860 30069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:39.378005 30069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:39.382881 30069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:39.383184 30069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:39.386076 30069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:39.386237 30069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:39.386334 30069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:39.386385 30069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:39.403280 30069 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:37265
I20260806 11:46:39.403663 30243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:37265 every 8 connection(s)
Aug 06 11:46:39 dist-test-slave-7z32 krb5kdc[29710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:39.405201 30069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:46:39.413193 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 30069
I20260806 11:46:39.413422 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:46:39.413612 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.386897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:35379 (local address 127.26.172.254:33351)
0806 11:46:39.387112 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:39.387118 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:39.388542 (+ 1424us) server_negotiation.cc:407] Connection header received
0806 11:46:39.390715 (+ 2173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:39.390720 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:39.390803 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:39.391077 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:39.393698 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.394849 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.397373 (+ 2524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.397968 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.398199 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.405289 (+ 7090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:39.405297 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:39.405301 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:39.405400 (+ 99us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:39.408363 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.409663 (+ 1300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.409668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.409670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.409853 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.410664 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.410670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.410674 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.411229 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:39.411457 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:39.413060 (+ 1603us) server_negotiation.cc:299] Negotiation successful
0806 11:46:39.413329 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 11:46:39.414021 27315 external_mini_cluster.cc:1428] Setting key 1f00e351f9f0b66410130c3d8dc0cddd
I20260806 11:46:39.415620 30098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.387456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33351 (local address 127.26.172.194:35379)
0806 11:46:39.388234 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:39.388327 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:39.390223 (+ 1896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:39.391630 (+ 1407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:39.391646 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:39.392442 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:39.393371 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.393404 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.395243 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.395249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.397099 (+ 1850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.397125 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.398335 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.398341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.398747 (+ 406us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.400506 (+ 1759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:39.400561 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:39.404829 (+ 4268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:39.408570 (+ 3741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.408579 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.408612 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.409469 (+ 857us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.410054 (+ 585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.410057 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.410059 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.410458 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.411437 (+ 979us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:39.411447 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:39.412070 (+ 623us) client_negotiation.cc:769] Sending connection context
0806 11:46:39.412518 (+ 448us) client_negotiation.cc:240] Negotiation successful
0806 11:46:39.413345 (+ 827us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":156,"threads_started":1}
I20260806 11:46:39.418306 30245 heartbeater.cc:347] Connected to a master server at 127.26.172.254:33351
I20260806 11:46:39.418726 30245 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:39.420236 30245 heartbeater.cc:511] Master 127.26.172.254:33351 requested a full tablet report, sending...
I20260806 11:46:39.422927 29768 ts_manager.cc:194] Registered new tserver with Master: f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265)
I20260806 11:46:39.424477 29768 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:35379
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:46:39.439884 30254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.423721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33351 (local address 127.26.172.194:60581)
0806 11:46:39.424606 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:39.424623 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:39.424865 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:39.425518 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:39.425525 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:39.426072 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:39.426469 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.426497 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.428204 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.428222 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.429887 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.430023 (+ 136us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.431149 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.431168 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.431392 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.432523 (+ 1131us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:39.432573 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:39.433534 (+ 961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:39.436900 (+ 3366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.436905 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.436908 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.437309 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.437789 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.437793 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.437795 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.437954 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.438808 (+ 854us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:39.438811 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:39.439021 (+ 210us) client_negotiation.cc:769] Sending connection context
0806 11:46:39.439228 (+ 207us) client_negotiation.cc:240] Negotiation successful
0806 11:46:39.439538 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":256,"threads_started":1}
I20260806 11:46:39.439850 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.423720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:60581 (local address 127.26.172.254:33351)
0806 11:46:39.424002 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:39.424011 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:39.424756 (+ 745us) server_negotiation.cc:407] Connection header received
0806 11:46:39.425045 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:39.425049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:39.425191 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:39.425353 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:39.426765 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.427884 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.430315 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.430731 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.431060 (+ 329us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.433892 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:39.433897 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:39.433900 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:39.433968 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:39.436650 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.437505 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.437511 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.437514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.437643 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.438123 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.438129 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.438133 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.438604 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:39.438812 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:39.439320 (+ 508us) server_negotiation.cc:299] Negotiation successful
0806 11:46:39.439535 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:46:39.475811 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33351
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:39.693838 30256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:39.694231 30256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:39.694285 30256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:39.700853 30256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:39.701011 30256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:39.701088 30256 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 11:46:39.701119 30256 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 11:46:39.701170 30256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:46:39.710723 30256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.172.254:33351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:39.713440 30256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:39.715302 30256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:39.733209 30262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:39.733239 30263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:39.733266 30266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:39.733857 30256 server_base.cc:1034] running on GCE node
I20260806 11:46:39.734812 30256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:39.736227 30256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:39.739696 30256 hybrid_clock.cc:648] HybridClock initialized: now 1786016799739611 us; error 106 us; skew 500 ppm
Aug 06 11:46:39 dist-test-slave-7z32 krb5kdc[29710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:39.747017 30256 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:46:39.749289 30256 webserver.cc:460] Webserver started at http://127.26.172.195:41817/ using document root <none> and password file <none>
I20260806 11:46:39.750473 30256 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:39.750617 30256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:39.751142 30256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:39.756953 30256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "294e3a396c6c43fc94ab759400928c9f"
format_stamp: "Formatted at 2026-08-06 11:46:39 on dist-test-slave-7z32"
server_key: "01c3d7808d936cafb023f41cf313122d"
server_key_iv: "946569147aca2249f5e4365b01997bf2"
server_key_version: "encryptionkey@0"
I20260806 11:46:39.758463 30256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "294e3a396c6c43fc94ab759400928c9f"
format_stamp: "Formatted at 2026-08-06 11:46:39 on dist-test-slave-7z32"
server_key: "01c3d7808d936cafb023f41cf313122d"
server_key_iv: "946569147aca2249f5e4365b01997bf2"
server_key_version: "encryptionkey@0"
I20260806 11:46:39.768664 30256 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.006s sys 0.000s
I20260806 11:46:39.775624 30274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:39.777735 30256 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:46:39.778020 30256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "294e3a396c6c43fc94ab759400928c9f"
format_stamp: "Formatted at 2026-08-06 11:46:39 on dist-test-slave-7z32"
server_key: "01c3d7808d936cafb023f41cf313122d"
server_key_iv: "946569147aca2249f5e4365b01997bf2"
server_key_version: "encryptionkey@0"
I20260806 11:46:39.778213 30256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:39.800504 30256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:39.805616 30256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:39.805891 30256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:39.808007 30256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:39.808077 30256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:39.808123 30256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:39.808139 30256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:39.822745 30256 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:36619
I20260806 11:46:39.822806 30433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:36619 every 8 connection(s)
I20260806 11:46:39.823930 30256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
Aug 06 11:46:39 dist-test-slave-7z32 krb5kdc[29710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016799, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:39.825438 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 30256
I20260806 11:46:39.825618 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:46:39.826072 27315 external_mini_cluster.cc:1428] Setting key 2be9fdaaa7b946859a09de36d9393807
I20260806 11:46:39.831377 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.809965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:57119 (local address 127.26.172.254:33351)
0806 11:46:39.810198 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:39.810205 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:39.812019 (+ 1814us) server_negotiation.cc:407] Connection header received
0806 11:46:39.814246 (+ 2227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:39.814254 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:39.814354 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:39.814497 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:39.817216 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.818030 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.820407 (+ 2377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.820865 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.821027 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.825992 (+ 4965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:39.825996 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:39.826000 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:39.826040 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:39.828110 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.828912 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.828916 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.828918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.829041 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.829714 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.829717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.829719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.830043 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:39.830147 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:39.831067 (+ 920us) server_negotiation.cc:299] Negotiation successful
0806 11:46:39.831230 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 11:46:39.832568 30289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.810727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33351 (local address 127.26.172.195:57119)
0806 11:46:39.811761 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:39.811856 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:39.813727 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:39.815005 (+ 1278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:39.815021 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:39.815755 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:39.816910 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.816942 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.818393 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.818400 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.820131 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.820151 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.821164 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.821173 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.821572 (+ 399us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.822785 (+ 1213us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:39.822815 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:39.825548 (+ 2733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:39.828294 (+ 2746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.828304 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.828328 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.828750 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.829190 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.829194 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.829195 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.829444 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.830198 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:39.830206 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:39.830620 (+ 414us) client_negotiation.cc:769] Sending connection context
0806 11:46:39.830976 (+ 356us) client_negotiation.cc:240] Negotiation successful
0806 11:46:39.831386 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":201,"threads_started":1}
I20260806 11:46:39.834470 30434 heartbeater.cc:347] Connected to a master server at 127.26.172.254:33351
I20260806 11:46:39.834764 30434 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:39.835654 30434 heartbeater.cc:511] Master 127.26.172.254:33351 requested a full tablet report, sending...
I20260806 11:46:39.837137 29774 ts_manager.cc:194] Registered new tserver with Master: 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619)
I20260806 11:46:39.837906 29774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:57119
I20260806 11:46:39.841933 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:46:39.850292 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.838279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:34695 (local address 127.26.172.254:33351)
0806 11:46:39.838485 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:39.838491 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:39.838755 (+ 264us) server_negotiation.cc:407] Connection header received
0806 11:46:39.839072 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:39.839075 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:39.839282 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:39.839408 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:39.840205 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.841093 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.842215 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.842649 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.842811 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.844801 (+ 1990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:39.844806 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:39.844809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:39.844848 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:39.847173 (+ 2325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.848092 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.848099 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.848104 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.848236 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.848764 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.848770 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.848774 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.849097 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:39.849235 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:39.849822 (+ 587us) server_negotiation.cc:299] Negotiation successful
0806 11:46:39.850038 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 11:46:39.850493 30440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.838159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33351 (local address 127.26.172.195:34695)
0806 11:46:39.838639 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:39.838655 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:39.838899 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:39.839504 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:39.839507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:39.839834 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:39.840005 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.840015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.841308 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.841311 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.841946 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.841955 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.843013 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.843017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.843121 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.843933 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:39.843948 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:39.844574 (+ 626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:39.847426 (+ 2852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.847432 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.847434 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.847904 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.848422 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:39.848426 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:39.848428 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:39.848601 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:39.849363 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:39.849368 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:39.849549 (+ 181us) client_negotiation.cc:769] Sending connection context
0806 11:46:39.849690 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 11:46:39.849932 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":171,"threads_started":1}
Aug 06 11:46:39 dist-test-slave-7z32 krb5kdc[29710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 11:46:39 dist-test-slave-7z32 krb5kdc[29710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016799, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:39.884171 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.871320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57672 (local address 127.26.172.254:33351)
0806 11:46:39.871544 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:39.871549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:39.871669 (+ 120us) server_negotiation.cc:407] Connection header received
0806 11:46:39.871877 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:39.871881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:39.871948 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:39.872058 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:39.873128 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.873778 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.875034 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.875287 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.875398 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.879787 (+ 4389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:39.879791 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:39.879794 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:39.879845 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:39.881560 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.882207 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.882211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.882212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.882307 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:39.882642 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:39.882646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:39.882648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:39.883063 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:39.883408 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:39.883740 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 11:46:39.883922 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 11:46:39.889683 29774 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57672:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:46:39.894548 29774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:39.917778 30458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.909362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37265 (local address 127.0.0.1:47082)
0806 11:46:39.911284 (+ 1922us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:39.911300 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:39.911426 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:39.912392 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:39.912401 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:39.912433 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:39.912757 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.912766 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.914261 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.914268 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.915736 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.915749 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.917108 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.917112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.917247 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.917300 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 11:46:39.917391 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 11:46:39.917571 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1075,"mutex_wait_us":194,"thread_start_us":185,"threads_started":1}
I20260806 11:46:39.918172 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.911342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34204 (local address 127.26.172.195:36619)
0806 11:46:39.912001 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:39.912012 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:39.912032 (+ 20us) server_negotiation.cc:407] Connection header received
0806 11:46:39.912109 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:39.912115 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:39.912326 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:39.912931 (+ 605us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:39.913090 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.914310 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.916363 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.917352 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.917536 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.917732 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:39.917809 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 11:46:39.917951 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":123,"threads_started":1}
I20260806 11:46:39.918561 30462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.911010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:36619 (local address 127.0.0.1:34204)
0806 11:46:39.911637 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:39.911649 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:39.911730 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:39.912521 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:39.912525 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:39.912572 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:39.912800 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.912809 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.914455 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.914458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.916159 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.916173 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.917516 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.917520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.917606 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.917628 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 11:46:39.917694 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 11:46:39.917760 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":328,"spinlock_wait_cycles":8576,"thread_start_us":158,"threads_started":1}
I20260806 11:46:39.918663 30461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.910477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53356 (local address 127.26.172.193:42417)
0806 11:46:39.910904 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:39.910915 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:39.911719 (+ 804us) server_negotiation.cc:407] Connection header received
0806 11:46:39.911832 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:39.911839 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:39.912093 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:39.912260 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:39.913073 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.914310 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.916862 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.917755 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.917893 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.918024 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:39.918357 (+ 333us) server_negotiation.cc:299] Negotiation successful
0806 11:46:39.918500 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":114,"threads_started":1}
I20260806 11:46:39.919250 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.909600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47082 (local address 127.26.172.194:37265)
0806 11:46:39.911663 (+ 2063us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:39.911681 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:39.911710 (+ 29us) server_negotiation.cc:407] Connection header received
0806 11:46:39.911866 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:39.911872 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:39.912155 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:39.912745 (+ 590us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:39.912915 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.914112 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.915946 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.916955 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.918695 (+ 1740us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.918932 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:39.918996 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 11:46:39.919101 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1946,"thread_start_us":198,"threads_started":1}
I20260806 11:46:39.918560 30459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:39.909473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42417 (local address 127.0.0.1:53356)
0806 11:46:39.910978 (+ 1505us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:39.911082 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:39.911322 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:39.912521 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:39.912525 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:39.912559 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:39.912933 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.912940 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.914471 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.914475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.916661 (+ 2186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:39.916673 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:39.917902 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:39.917908 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:39.918113 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:39.918137 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 11:46:39.918227 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 11:46:39.918323 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1395,"mutex_wait_us":410,"spinlock_wait_cycles":6528,"thread_start_us":93,"threads_started":1}
I20260806 11:46:39.922709 29973 tablet_service.cc:1467] Processing CreateTablet for tablet f94890ecadc542d2ab58486f4ed1bf6f (DEFAULT_TABLE table=test-table [id=107e0f28b8f64b28af4f7ab17d2e6f25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:39.923135 30342 tablet_service.cc:1467] Processing CreateTablet for tablet f94890ecadc542d2ab58486f4ed1bf6f (DEFAULT_TABLE table=test-table [id=107e0f28b8f64b28af4f7ab17d2e6f25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:39.923132 30140 tablet_service.cc:1467] Processing CreateTablet for tablet f94890ecadc542d2ab58486f4ed1bf6f (DEFAULT_TABLE table=test-table [id=107e0f28b8f64b28af4f7ab17d2e6f25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:39.924108 29973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f94890ecadc542d2ab58486f4ed1bf6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:39.924790 30140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f94890ecadc542d2ab58486f4ed1bf6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:39.924796 30342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f94890ecadc542d2ab58486f4ed1bf6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:39.932684 30464 tablet_bootstrap.cc:492] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: Bootstrap starting.
I20260806 11:46:39.935222 30464 tablet_bootstrap.cc:654] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:39.935488 30465 tablet_bootstrap.cc:492] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: Bootstrap starting.
I20260806 11:46:39.936261 30464 log.cc:824] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:39.937186 30466 tablet_bootstrap.cc:492] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: Bootstrap starting.
I20260806 11:46:39.938660 30465 tablet_bootstrap.cc:654] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:39.939287 30464 tablet_bootstrap.cc:492] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: No bootstrap required, opened a new log
I20260806 11:46:39.939538 30464 ts_tablet_manager.cc:1397] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20260806 11:46:39.939659 30465 log.cc:824] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:39.940886 30466 tablet_bootstrap.cc:654] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:39.941906 30466 log.cc:824] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:39.942237 30465 tablet_bootstrap.cc:492] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: No bootstrap required, opened a new log
I20260806 11:46:39.942492 30465 ts_tablet_manager.cc:1397] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260806 11:46:39.944834 30466 tablet_bootstrap.cc:492] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: No bootstrap required, opened a new log
I20260806 11:46:39.944687 30464 raft_consensus.cc:348] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:39.945031 30464 raft_consensus.cc:374] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:39.945109 30464 raft_consensus.cc:729] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e69c604312c44938c616a3b51fef24a, State: Initialized, Role: FOLLOWER
I20260806 11:46:39.945418 30466 ts_tablet_manager.cc:1397] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 11:46:39.945665 30464 consensus_queue.cc:260] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:39.946885 30059 heartbeater.cc:503] Master 127.26.172.254:33351 was elected leader, sending a full tablet report...
I20260806 11:46:39.946969 30464 ts_tablet_manager.cc:1428] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: Time spent starting tablet: real 0.007s user 0.005s sys 0.003s
I20260806 11:46:39.947371 30465 raft_consensus.cc:348] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:39.947712 30465 raft_consensus.cc:374] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:39.947768 30465 raft_consensus.cc:729] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82f223f2ab8436b8c398ddfee40894e, State: Initialized, Role: FOLLOWER
I20260806 11:46:39.948428 30465 consensus_queue.cc:260] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:39.949474 30465 ts_tablet_manager.cc:1428] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260806 11:46:39.950080 30245 heartbeater.cc:503] Master 127.26.172.254:33351 was elected leader, sending a full tablet report...
I20260806 11:46:39.950861 30466 raft_consensus.cc:348] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:39.951292 30466 raft_consensus.cc:374] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:39.951373 30466 raft_consensus.cc:729] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 294e3a396c6c43fc94ab759400928c9f, State: Initialized, Role: FOLLOWER
I20260806 11:46:39.952064 30466 consensus_queue.cc:260] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:39.953230 30434 heartbeater.cc:503] Master 127.26.172.254:33351 was elected leader, sending a full tablet report...
I20260806 11:46:39.953763 30466 ts_tablet_manager.cc:1428] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260806 11:46:40.075521 30435 tablet.cc:2369] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:46:40.099946 30060 tablet.cc:2369] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:46:40.105650 30473 raft_consensus.cc:482] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:40.106143 30473 raft_consensus.cc:504] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.107755 30473 leader_election.cc:288] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265), 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417)
I20260806 11:46:40.113906 30289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.108231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37265 (local address 127.26.172.195:47533)
0806 11:46:40.108405 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:40.108426 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:40.108568 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:40.109030 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:40.109033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:40.109073 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:40.109335 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.109345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.110631 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.110635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.112120 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.112133 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.113312 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.113316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.113481 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.113508 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 11:46:40.113614 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 11:46:40.113735 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 11:46:40.113889 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.108356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:47533 (local address 127.26.172.194:37265)
0806 11:46:40.108543 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.108548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.108576 (+ 28us) server_negotiation.cc:407] Connection header received
0806 11:46:40.108745 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.108749 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.108858 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.108994 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:40.109510 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.110442 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.112349 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.113114 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.113311 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.113379 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.113636 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.113717 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 11:46:40.114097 30461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.108380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:35867 (local address 127.26.172.193:42417)
0806 11:46:40.108763 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.108769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.109162 (+ 393us) server_negotiation.cc:407] Connection header received
0806 11:46:40.109406 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.109412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.109486 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.109562 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:40.110631 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.111531 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.112944 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.113411 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.113565 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.113640 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.113845 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.113939 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250}
I20260806 11:46:40.114122 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.108240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42417 (local address 127.26.172.195:35867)
0806 11:46:40.109055 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:40.109076 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:40.109252 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:40.109614 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:40.109618 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:40.109639 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:40.110330 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.110342 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.111754 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.111758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.112790 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.112806 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.113565 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.113569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.113681 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.113721 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 11:46:40.113824 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 11:46:40.113921 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"mutex_wait_us":200,"thread_start_us":320,"threads_started":1}
I20260806 11:46:40.114789 30185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f94890ecadc542d2ab58486f4ed1bf6f" candidate_uuid: "294e3a396c6c43fc94ab759400928c9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82f223f2ab8436b8c398ddfee40894e" is_pre_election: true
I20260806 11:46:40.115091 29999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f94890ecadc542d2ab58486f4ed1bf6f" candidate_uuid: "294e3a396c6c43fc94ab759400928c9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e69c604312c44938c616a3b51fef24a" is_pre_election: true
I20260806 11:46:40.115374 30185 raft_consensus.cc:2454] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 294e3a396c6c43fc94ab759400928c9f in term 0.
I20260806 11:46:40.115739 29999 raft_consensus.cc:2454] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 294e3a396c6c43fc94ab759400928c9f in term 0.
I20260806 11:46:40.116109 30278 leader_election.cc:302] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 294e3a396c6c43fc94ab759400928c9f, f82f223f2ab8436b8c398ddfee40894e; no voters:
I20260806 11:46:40.116472 30473 raft_consensus.cc:2781] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:40.116583 30473 raft_consensus.cc:482] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:40.116619 30473 raft_consensus.cc:3037] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:40.117933 30473 raft_consensus.cc:504] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.118535 30473 leader_election.cc:288] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [CANDIDATE]: Term 1 election: Requested vote from peers f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265), 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417)
I20260806 11:46:40.119215 30185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f94890ecadc542d2ab58486f4ed1bf6f" candidate_uuid: "294e3a396c6c43fc94ab759400928c9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82f223f2ab8436b8c398ddfee40894e"
I20260806 11:46:40.119400 30185 raft_consensus.cc:3037] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:40.119488 29999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f94890ecadc542d2ab58486f4ed1bf6f" candidate_uuid: "294e3a396c6c43fc94ab759400928c9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e69c604312c44938c616a3b51fef24a"
I20260806 11:46:40.119823 29999 raft_consensus.cc:3037] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:40.120846 30185 raft_consensus.cc:2454] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 294e3a396c6c43fc94ab759400928c9f in term 1.
I20260806 11:46:40.121340 30278 leader_election.cc:302] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 294e3a396c6c43fc94ab759400928c9f, f82f223f2ab8436b8c398ddfee40894e; no voters:
I20260806 11:46:40.121394 29999 raft_consensus.cc:2454] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 294e3a396c6c43fc94ab759400928c9f in term 1.
I20260806 11:46:40.121635 30473 raft_consensus.cc:2781] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:40.121933 30473 raft_consensus.cc:686] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 1 LEADER]: Becoming Leader. State: Replica: 294e3a396c6c43fc94ab759400928c9f, State: Running, Role: LEADER
I20260806 11:46:40.122354 30473 consensus_queue.cc:237] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.127144 29774 catalog_manager.cc:5495] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 294e3a396c6c43fc94ab759400928c9f (127.26.172.195). New cstate: current_term: 1 leader_uuid: "294e3a396c6c43fc94ab759400928c9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } health_report { overall_health: HEALTHY } } }
W20260806 11:46:40.157244 30246 tablet.cc:2369] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 11:46:40 dist-test-slave-7z32 krb5kdc[29710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016798, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:40.199895 30485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.189411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33351 (local address 127.0.0.1:57674)
0806 11:46:40.190034 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:40.190051 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:40.190242 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:40.190580 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:40.190583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:40.191208 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:40.191311 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.191318 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.192173 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.192180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.192809 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.192818 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.193326 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.193330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.193426 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.194236 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:40.194249 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:40.195970 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:40.197944 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:40.197958 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:40.197967 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:40.198229 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:40.198592 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:40.198599 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:40.198601 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:40.198694 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:40.199198 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:40.199207 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:40.199332 (+ 125us) client_negotiation.cc:769] Sending connection context
0806 11:46:40.199462 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 11:46:40.199671 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":220,"threads_started":1}
I20260806 11:46:40.199893 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.189617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57674 (local address 127.26.172.254:33351)
0806 11:46:40.189930 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.189936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.190168 (+ 232us) server_negotiation.cc:407] Connection header received
0806 11:46:40.190366 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.190370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.190427 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.190542 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:40.191461 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.192045 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.192950 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.193191 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.193315 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.196161 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:40.196165 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:40.196167 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:40.196189 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:40.197814 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:40.198368 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:40.198374 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:40.198376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:40.198459 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:40.198801 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:40.198806 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:40.198808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:40.199077 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:40.199198 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.199521 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.199743 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":103,"server-negotiator.queue_time_us":104}
I20260806 11:46:40.205720 29774 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:57674:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 11:46:40.206688 29774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:40.215691 29973 tablet_service.cc:1467] Processing CreateTablet for tablet 9415cd762a254c248895fd195df5b6a5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0a16abd02c4d402280dd7bdd45448452]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 11:46:40.215826 30342 tablet_service.cc:1467] Processing CreateTablet for tablet 9415cd762a254c248895fd195df5b6a5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0a16abd02c4d402280dd7bdd45448452]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 11:46:40.216718 30342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9415cd762a254c248895fd195df5b6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:40.216718 29973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9415cd762a254c248895fd195df5b6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:40.217331 30140 tablet_service.cc:1467] Processing CreateTablet for tablet 9415cd762a254c248895fd195df5b6a5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0a16abd02c4d402280dd7bdd45448452]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 11:46:40.218806 30140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9415cd762a254c248895fd195df5b6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:40.220494 30466 tablet_bootstrap.cc:492] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: Bootstrap starting.
I20260806 11:46:40.220494 30464 tablet_bootstrap.cc:492] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: Bootstrap starting.
I20260806 11:46:40.221701 30466 tablet_bootstrap.cc:654] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:40.221701 30464 tablet_bootstrap.cc:654] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:40.223380 30464 tablet_bootstrap.cc:492] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: No bootstrap required, opened a new log
I20260806 11:46:40.223490 30466 tablet_bootstrap.cc:492] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: No bootstrap required, opened a new log
I20260806 11:46:40.223505 30464 ts_tablet_manager.cc:1397] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 11:46:40.223588 30466 ts_tablet_manager.cc:1397] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 11:46:40.224050 30465 tablet_bootstrap.cc:492] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: Bootstrap starting.
I20260806 11:46:40.224071 30464 raft_consensus.cc:348] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.224071 30466 raft_consensus.cc:348] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.224207 30464 raft_consensus.cc:374] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:40.224207 30466 raft_consensus.cc:374] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:40.224246 30466 raft_consensus.cc:729] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 294e3a396c6c43fc94ab759400928c9f, State: Initialized, Role: FOLLOWER
I20260806 11:46:40.224246 30464 raft_consensus.cc:729] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e69c604312c44938c616a3b51fef24a, State: Initialized, Role: FOLLOWER
I20260806 11:46:40.224401 30464 consensus_queue.cc:260] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.224401 30466 consensus_queue.cc:260] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.224711 30464 ts_tablet_manager.cc:1428] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260806 11:46:40.224673 30473 tablet_replica.cc:439] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } } }
I20260806 11:46:40.224880 30473 tablet_replica.cc:442] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:40.225172 30466 ts_tablet_manager.cc:1428] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 11:46:40.225646 30471 tablet_replica.cc:439] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } } }
I20260806 11:46:40.225836 30471 tablet_replica.cc:442] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:40.226263 30465 tablet_bootstrap.cc:654] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:40.228538 30465 tablet_bootstrap.cc:492] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: No bootstrap required, opened a new log
I20260806 11:46:40.228767 30465 ts_tablet_manager.cc:1397] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260806 11:46:40.229378 30465 raft_consensus.cc:348] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.229542 30465 raft_consensus.cc:374] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:40.229591 30465 raft_consensus.cc:729] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82f223f2ab8436b8c398ddfee40894e, State: Initialized, Role: FOLLOWER
I20260806 11:46:40.229797 30465 consensus_queue.cc:260] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.230151 30465 ts_tablet_manager.cc:1428] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 11:46:40.230159 30472 tablet_replica.cc:439] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } } }
I20260806 11:46:40.230639 30472 tablet_replica.cc:442] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:40.394167 30472 raft_consensus.cc:482] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:40.394420 30472 raft_consensus.cc:504] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.396333 30472 leader_election.cc:288] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417), 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619)
I20260806 11:46:40.402091 30461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.396846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:35913 (local address 127.26.172.193:42417)
0806 11:46:40.397039 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.397046 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.397238 (+ 192us) server_negotiation.cc:407] Connection header received
0806 11:46:40.397601 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.397608 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.397674 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.397755 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:40.398267 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.399092 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.400626 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.401266 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.401414 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.401477 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.401866 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.401958 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 11:46:40.402092 30490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.396656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42417 (local address 127.26.172.194:35913)
0806 11:46:40.397106 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:40.397126 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:40.397363 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:40.397803 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:40.397806 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:40.397828 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:40.398109 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.398120 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.399262 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.399266 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.400463 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.400474 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.401472 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.401476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.401597 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.401635 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 11:46:40.401745 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 11:46:40.401848 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":46,"thread_start_us":179,"threads_started":1}
I20260806 11:46:40.403106 30491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.396846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:36619 (local address 127.26.172.194:49795)
0806 11:46:40.397324 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:40.397339 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:40.397510 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:40.397934 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:40.397936 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:40.397953 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:40.398625 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.398637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.400029 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.400032 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.401223 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.401237 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.402534 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.402539 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.402655 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.402688 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 11:46:40.402804 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 11:46:40.402937 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":9,"thread_start_us":161,"threads_started":1}
I20260806 11:46:40.403026 29999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9415cd762a254c248895fd195df5b6a5" candidate_uuid: "f82f223f2ab8436b8c398ddfee40894e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e69c604312c44938c616a3b51fef24a" is_pre_election: true
I20260806 11:46:40.403172 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.397167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:49795 (local address 127.26.172.195:36619)
0806 11:46:40.397322 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.397326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.397448 (+ 122us) server_negotiation.cc:407] Connection header received
0806 11:46:40.397710 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.397712 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.397799 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.397894 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:40.398797 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.399866 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.401413 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.402103 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.402289 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.402359 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.402943 (+ 584us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.403035 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 11:46:40.403277 29999 raft_consensus.cc:2454] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82f223f2ab8436b8c398ddfee40894e in term 0.
I20260806 11:46:40.403812 30091 leader_election.cc:302] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e69c604312c44938c616a3b51fef24a, f82f223f2ab8436b8c398ddfee40894e; no voters:
I20260806 11:46:40.403899 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9415cd762a254c248895fd195df5b6a5" candidate_uuid: "f82f223f2ab8436b8c398ddfee40894e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "294e3a396c6c43fc94ab759400928c9f" is_pre_election: true
I20260806 11:46:40.404170 30369 raft_consensus.cc:2454] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82f223f2ab8436b8c398ddfee40894e in term 0.
I20260806 11:46:40.404251 30472 raft_consensus.cc:2781] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:40.404332 30472 raft_consensus.cc:482] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:40.404382 30472 raft_consensus.cc:3037] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:40.405953 30472 raft_consensus.cc:504] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.406481 30472 leader_election.cc:288] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [CANDIDATE]: Term 1 election: Requested vote from peers 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417), 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619)
I20260806 11:46:40.407196 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9415cd762a254c248895fd195df5b6a5" candidate_uuid: "f82f223f2ab8436b8c398ddfee40894e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "294e3a396c6c43fc94ab759400928c9f"
I20260806 11:46:40.407275 29999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9415cd762a254c248895fd195df5b6a5" candidate_uuid: "f82f223f2ab8436b8c398ddfee40894e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e69c604312c44938c616a3b51fef24a"
I20260806 11:46:40.407408 30369 raft_consensus.cc:3037] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:40.407505 29999 raft_consensus.cc:3037] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:40.409400 29999 raft_consensus.cc:2454] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82f223f2ab8436b8c398ddfee40894e in term 1.
I20260806 11:46:40.409766 30369 raft_consensus.cc:2454] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82f223f2ab8436b8c398ddfee40894e in term 1.
I20260806 11:46:40.410092 30091 leader_election.cc:302] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e69c604312c44938c616a3b51fef24a, f82f223f2ab8436b8c398ddfee40894e; no voters:
I20260806 11:46:40.410398 30472 raft_consensus.cc:2781] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:40.410699 30472 raft_consensus.cc:686] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [term 1 LEADER]: Becoming Leader. State: Replica: f82f223f2ab8436b8c398ddfee40894e, State: Running, Role: LEADER
I20260806 11:46:40.411355 30472 consensus_queue.cc:237] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.414814 30493 tablet_replica.cc:439] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: TxnStatusTablet state changed. Reason: New leader f82f223f2ab8436b8c398ddfee40894e. Latest consensus state: current_term: 1 leader_uuid: "f82f223f2ab8436b8c398ddfee40894e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } } }
I20260806 11:46:40.415009 30493 tablet_replica.cc:442] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: This TxnStatusTablet replica's current role is: LEADER
I20260806 11:46:40.416109 30498 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 11:46:40.416388 30498 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 11:46:40.416385 29768 catalog_manager.cc:5495] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e reported cstate change: term changed from 0 to 1, leader changed from <none> to f82f223f2ab8436b8c398ddfee40894e (127.26.172.194). New cstate: current_term: 1 leader_uuid: "f82f223f2ab8436b8c398ddfee40894e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } health_report { overall_health: UNKNOWN } } }
I20260806 11:46:40.473965 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.468898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47098 (local address 127.26.172.194:37265)
0806 11:46:40.469082 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.469086 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.469107 (+ 21us) server_negotiation.cc:407] Connection header received
0806 11:46:40.469387 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.469389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.469465 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.469604 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:40.469938 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.470504 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.471880 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.472197 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.472327 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.472756 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:40.473433 (+ 677us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:40.473578 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.473722 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.473804 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 11:46:40.473994 30485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.468654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37265 (local address 127.0.0.1:47098)
0806 11:46:40.469023 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:40.469041 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:40.469174 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:40.469649 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:40.469652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:40.469662 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:46:40.469801 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.469808 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.470630 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.470634 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.471692 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.471705 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.472362 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.472366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.472465 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.472537 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:46:40.473583 (+ 1046us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:46:40.473603 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 11:46:40.473691 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 11:46:40.473804 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208}
I20260806 11:46:40.481922 29999 raft_consensus.cc:1261] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Refusing update from remote peer f82f223f2ab8436b8c398ddfee40894e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:40.481913 30369 raft_consensus.cc:1261] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Refusing update from remote peer f82f223f2ab8436b8c398ddfee40894e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:40.482861 30493 consensus_queue.cc:1035] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [LEADER]: Connected to new peer: Peer: permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:40.483388 30472 consensus_queue.cc:1035] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:40.488808 30473 tablet_replica.cc:439] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: TxnStatusTablet state changed. Reason: New leader f82f223f2ab8436b8c398ddfee40894e. Latest consensus state: current_term: 1 leader_uuid: "f82f223f2ab8436b8c398ddfee40894e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } } }
I20260806 11:46:40.489033 30473 tablet_replica.cc:442] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:40.489332 30471 tablet_replica.cc:439] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: TxnStatusTablet state changed. Reason: New leader f82f223f2ab8436b8c398ddfee40894e. Latest consensus state: current_term: 1 leader_uuid: "f82f223f2ab8436b8c398ddfee40894e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } } }
I20260806 11:46:40.489511 30471 tablet_replica.cc:442] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:40.497040 30502 mvcc.cc:205] Tried to move back new op lower bound from 7315524814762258432 to 7315524814489427968. Current Snapshot: MvccSnapshot[applied={T|T < 7315524814762258432}]
I20260806 11:46:40.497243 30472 tablet_replica.cc:439] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f82f223f2ab8436b8c398ddfee40894e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } } }
I20260806 11:46:40.497390 30472 tablet_replica.cc:442] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: This TxnStatusTablet replica's current role is: LEADER
I20260806 11:46:40.497524 30472 tablet_replica.cc:439] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f82f223f2ab8436b8c398ddfee40894e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } } }
I20260806 11:46:40.497592 30472 tablet_replica.cc:442] T 9415cd762a254c248895fd195df5b6a5 P f82f223f2ab8436b8c398ddfee40894e: This TxnStatusTablet replica's current role is: LEADER
I20260806 11:46:40.498546 30471 tablet_replica.cc:439] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f82f223f2ab8436b8c398ddfee40894e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } } }
I20260806 11:46:40.498747 30471 tablet_replica.cc:442] T 9415cd762a254c248895fd195df5b6a5 P 0e69c604312c44938c616a3b51fef24a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:40.501458 30503 mvcc.cc:205] Tried to move back new op lower bound from 7315524814762258432 to 7315524814489427968. Current Snapshot: MvccSnapshot[applied={T|T < 7315524814762258432 or (T in {7315524814762258432})}]
I20260806 11:46:40.502296 30473 tablet_replica.cc:439] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f82f223f2ab8436b8c398ddfee40894e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } } }
I20260806 11:46:40.502477 30473 tablet_replica.cc:442] T 9415cd762a254c248895fd195df5b6a5 P 294e3a396c6c43fc94ab759400928c9f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:46:40.505206 30504 mvcc.cc:205] Tried to move back new op lower bound from 7315524814762258432 to 7315524814489427968. Current Snapshot: MvccSnapshot[applied={T|T < 7315524814762258432}]
I20260806 11:46:40.513692 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.507518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34206 (local address 127.26.172.195:36619)
0806 11:46:40.507663 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.507670 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.508075 (+ 405us) server_negotiation.cc:407] Connection header received
0806 11:46:40.508323 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.508326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.508392 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.508536 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:40.508838 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.509481 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.511019 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.511517 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.511686 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.512293 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:40.513030 (+ 737us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:40.513179 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.513417 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.513505 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 11:46:40.522202 30473 consensus_queue.cc:1035] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:40.531196 30520 consensus_queue.cc:1035] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:40.535115 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.526052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:54681 (local address 127.26.172.194:37265)
0806 11:46:40.526314 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.526320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.527291 (+ 971us) server_negotiation.cc:407] Connection header received
0806 11:46:40.527594 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.527601 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.527679 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.527779 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:40.528353 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.529262 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.532279 (+ 3017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.532688 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.532781 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.533600 (+ 819us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:40.533726 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:40.533812 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.534828 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.534959 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 11:46:40.535930 30519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.525604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37265 (local address 127.26.172.195:54681)
0806 11:46:40.527025 (+ 1421us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:40.527048 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:40.527369 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:40.527826 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:40.527829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:40.527842 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:46:40.528066 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.528083 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.531014 (+ 2931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.531021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.532091 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.532113 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.532943 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.532946 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.533084 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.533270 (+ 186us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:46:40.534672 (+ 1402us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:46:40.534683 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 11:46:40.535382 (+ 699us) client_negotiation.cc:240] Negotiation successful
0806 11:46:40.535712 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1132,"thread_start_us":195,"threads_started":1}
I20260806 11:46:40.583652 30463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.577971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:34187 (local address 127.26.172.195:36619)
0806 11:46:40.578123 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.578129 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.578513 (+ 384us) server_negotiation.cc:407] Connection header received
0806 11:46:40.578887 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.578890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.578964 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.579078 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:40.579733 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.580921 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.582111 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.582369 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.582517 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.582988 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:40.583132 (+ 144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:40.583242 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.583377 (+ 135us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.583452 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 11:46:40.584043 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.577424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:36619 (local address 127.26.172.194:34187)
0806 11:46:40.578282 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:40.578302 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:40.578622 (+ 320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:40.579091 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:40.579095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:40.579104 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:46:40.579260 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.579393 (+ 133us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.581105 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.581108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.581959 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.581970 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.582594 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.582598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.582686 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.582762 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:46:40.583249 (+ 487us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:46:40.583258 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 11:46:40.583352 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 11:46:40.583469 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":173,"threads_started":1}
I20260806 11:46:40.624214 29768 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:40.624490 29768 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:40.627871 29768 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106: Sending DeleteTablet for 3 replicas of tablet f94890ecadc542d2ab58486f4ed1bf6f
I20260806 11:46:40.629009 29973 tablet_service.cc:1514] Processing DeleteTablet for tablet f94890ecadc542d2ab58486f4ed1bf6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:40 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:53356
I20260806 11:46:40.629204 30342 tablet_service.cc:1514] Processing DeleteTablet for tablet f94890ecadc542d2ab58486f4ed1bf6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:40 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:34204
I20260806 11:46:40.629774 30529 tablet_replica.cc:330] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: stopping tablet replica
I20260806 11:46:40.630084 29768 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57672:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 11:46:40.630139 30140 tablet_service.cc:1514] Processing DeleteTablet for tablet f94890ecadc542d2ab58486f4ed1bf6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:40 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:47082
I20260806 11:46:40.630251 30529 raft_consensus.cc:2229] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260806 11:46:40.630645 29768 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:40.630882 30530 tablet_replica.cc:330] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: stopping tablet replica
I20260806 11:46:40.631145 30529 raft_consensus.cc:2258] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:40.631366 30530 raft_consensus.cc:2229] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:46:40.632395 30530 raft_consensus.cc:2258] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:40.632700 30531 tablet_replica.cc:330] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: stopping tablet replica
I20260806 11:46:40.633121 30531 raft_consensus.cc:2229] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:40.633353 30531 raft_consensus.cc:2258] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:40.634982 30531 ts_tablet_manager.cc:1905] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:40.635253 30530 ts_tablet_manager.cc:1905] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:40.638875 29973 tablet_service.cc:1467] Processing CreateTablet for tablet 10d24878b23c44eba1de73e47c8e92b2 (DEFAULT_TABLE table=test-table [id=b9709135719346be8e25c4c0556f50f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:40.639263 29973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10d24878b23c44eba1de73e47c8e92b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:40.639276 30531 ts_tablet_manager.cc:1918] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:46:40.639396 30531 log.cc:1196] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/f94890ecadc542d2ab58486f4ed1bf6f
I20260806 11:46:40.639765 30531 ts_tablet_manager.cc:1939] T f94890ecadc542d2ab58486f4ed1bf6f P f82f223f2ab8436b8c398ddfee40894e: Deleting consensus metadata
I20260806 11:46:40.640385 30342 tablet_service.cc:1467] Processing CreateTablet for tablet 10d24878b23c44eba1de73e47c8e92b2 (DEFAULT_TABLE table=test-table [id=b9709135719346be8e25c4c0556f50f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:40.640749 30342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10d24878b23c44eba1de73e47c8e92b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:40.641477 30530 ts_tablet_manager.cc:1918] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:46:40.641641 30530 log.cc:1196] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/f94890ecadc542d2ab58486f4ed1bf6f
I20260806 11:46:40.642069 30530 ts_tablet_manager.cc:1939] T f94890ecadc542d2ab58486f4ed1bf6f P 294e3a396c6c43fc94ab759400928c9f: Deleting consensus metadata
I20260806 11:46:40.642324 30464 tablet_bootstrap.cc:492] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a: Bootstrap starting.
I20260806 11:46:40.643187 30140 tablet_service.cc:1467] Processing CreateTablet for tablet 10d24878b23c44eba1de73e47c8e92b2 (DEFAULT_TABLE table=test-table [id=b9709135719346be8e25c4c0556f50f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:40.643456 30464 tablet_bootstrap.cc:654] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:40.643523 30140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10d24878b23c44eba1de73e47c8e92b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:40.644408 29760 catalog_manager.cc:4841] TS 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619): tablet f94890ecadc542d2ab58486f4ed1bf6f (table test-table [id=107e0f28b8f64b28af4f7ab17d2e6f25]) successfully deleted
I20260806 11:46:40.645974 30464 tablet_bootstrap.cc:492] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a: No bootstrap required, opened a new log
I20260806 11:46:40.646104 30464 ts_tablet_manager.cc:1397] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 11:46:40.646155 30465 tablet_bootstrap.cc:492] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e: Bootstrap starting.
I20260806 11:46:40.646727 30464 raft_consensus.cc:348] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.646952 30464 raft_consensus.cc:374] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:40.646994 30464 raft_consensus.cc:729] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e69c604312c44938c616a3b51fef24a, State: Initialized, Role: FOLLOWER
I20260806 11:46:40.647146 30465 tablet_bootstrap.cc:654] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:40.647152 30464 consensus_queue.cc:260] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.647456 30466 tablet_bootstrap.cc:492] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f: Bootstrap starting.
I20260806 11:46:40.647495 30464 ts_tablet_manager.cc:1428] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 11:46:40.648497 30466 tablet_bootstrap.cc:654] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:40.649941 29760 catalog_manager.cc:4841] TS f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265): tablet f94890ecadc542d2ab58486f4ed1bf6f (table test-table [id=107e0f28b8f64b28af4f7ab17d2e6f25]) successfully deleted
I20260806 11:46:40.649984 30529 ts_tablet_manager.cc:1905] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:40.652344 30465 tablet_bootstrap.cc:492] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e: No bootstrap required, opened a new log
I20260806 11:46:40.652405 30466 tablet_bootstrap.cc:492] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f: No bootstrap required, opened a new log
I20260806 11:46:40.652479 30465 ts_tablet_manager.cc:1397] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260806 11:46:40.652606 30466 ts_tablet_manager.cc:1397] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 11:46:40.653056 30465 raft_consensus.cc:348] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.653214 30465 raft_consensus.cc:374] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:40.653260 30465 raft_consensus.cc:729] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82f223f2ab8436b8c398ddfee40894e, State: Initialized, Role: FOLLOWER
I20260806 11:46:40.653234 30466 raft_consensus.cc:348] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.653412 30466 raft_consensus.cc:374] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:40.653461 30466 raft_consensus.cc:729] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 294e3a396c6c43fc94ab759400928c9f, State: Initialized, Role: FOLLOWER
I20260806 11:46:40.653419 30465 consensus_queue.cc:260] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.653720 30465 ts_tablet_manager.cc:1428] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 11:46:40.654381 30529 ts_tablet_manager.cc:1918] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:46:40.654572 30529 log.cc:1196] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/f94890ecadc542d2ab58486f4ed1bf6f
I20260806 11:46:40.655073 30529 ts_tablet_manager.cc:1939] T f94890ecadc542d2ab58486f4ed1bf6f P 0e69c604312c44938c616a3b51fef24a: Deleting consensus metadata
I20260806 11:46:40.655468 30466 consensus_queue.cc:260] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.655983 30466 ts_tablet_manager.cc:1428] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260806 11:46:40.657253 29759 catalog_manager.cc:4841] TS 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417): tablet f94890ecadc542d2ab58486f4ed1bf6f (table test-table [id=107e0f28b8f64b28af4f7ab17d2e6f25]) successfully deleted
I20260806 11:46:40.706808 30472 raft_consensus.cc:482] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:40.707082 30472 raft_consensus.cc:504] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.707690 30472 leader_election.cc:288] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417), 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619)
I20260806 11:46:40.708390 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10d24878b23c44eba1de73e47c8e92b2" candidate_uuid: "f82f223f2ab8436b8c398ddfee40894e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "294e3a396c6c43fc94ab759400928c9f" is_pre_election: true
I20260806 11:46:40.708465 29999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10d24878b23c44eba1de73e47c8e92b2" candidate_uuid: "f82f223f2ab8436b8c398ddfee40894e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e69c604312c44938c616a3b51fef24a" is_pre_election: true
I20260806 11:46:40.708607 30369 raft_consensus.cc:2454] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82f223f2ab8436b8c398ddfee40894e in term 0.
I20260806 11:46:40.708742 29999 raft_consensus.cc:2454] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82f223f2ab8436b8c398ddfee40894e in term 0.
I20260806 11:46:40.709087 30092 leader_election.cc:302] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 294e3a396c6c43fc94ab759400928c9f, f82f223f2ab8436b8c398ddfee40894e; no voters:
I20260806 11:46:40.709300 30472 raft_consensus.cc:2781] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:40.709360 30472 raft_consensus.cc:482] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:40.709419 30472 raft_consensus.cc:3037] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:40.711081 30472 raft_consensus.cc:504] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.711611 30472 leader_election.cc:288] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [CANDIDATE]: Term 1 election: Requested vote from peers 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417), 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619)
I20260806 11:46:40.712110 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10d24878b23c44eba1de73e47c8e92b2" candidate_uuid: "f82f223f2ab8436b8c398ddfee40894e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "294e3a396c6c43fc94ab759400928c9f"
I20260806 11:46:40.712276 30369 raft_consensus.cc:3037] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:40.712208 29999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10d24878b23c44eba1de73e47c8e92b2" candidate_uuid: "f82f223f2ab8436b8c398ddfee40894e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e69c604312c44938c616a3b51fef24a"
I20260806 11:46:40.712467 29999 raft_consensus.cc:3037] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:40.713551 30369 raft_consensus.cc:2454] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82f223f2ab8436b8c398ddfee40894e in term 1.
I20260806 11:46:40.714017 30092 leader_election.cc:302] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 294e3a396c6c43fc94ab759400928c9f, f82f223f2ab8436b8c398ddfee40894e; no voters:
I20260806 11:46:40.714102 29999 raft_consensus.cc:2454] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82f223f2ab8436b8c398ddfee40894e in term 1.
I20260806 11:46:40.714299 30472 raft_consensus.cc:2781] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:40.714612 30472 raft_consensus.cc:686] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 1 LEADER]: Becoming Leader. State: Replica: f82f223f2ab8436b8c398ddfee40894e, State: Running, Role: LEADER
I20260806 11:46:40.715955 30472 consensus_queue.cc:237] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:40.719334 29768 catalog_manager.cc:5495] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e reported cstate change: term changed from 0 to 1, leader changed from <none> to f82f223f2ab8436b8c398ddfee40894e (127.26.172.194). New cstate: current_term: 1 leader_uuid: "f82f223f2ab8436b8c398ddfee40894e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } health_report { overall_health: UNKNOWN } } }
I20260806 11:46:40.740175 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.736711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47100 (local address 127.26.172.194:37265)
0806 11:46:40.736861 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.736866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.736947 (+ 81us) server_negotiation.cc:407] Connection header received
0806 11:46:40.737135 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.737139 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.737199 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.737284 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:40.737559 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.738090 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.739061 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.739287 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.739400 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.739692 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:40.739778 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:40.739864 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.739957 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.740018 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 11:46:40.754374 30526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.749784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37265 (local address 127.26.172.194:51275)
0806 11:46:40.750030 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:40.750047 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:40.750167 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:40.750626 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:40.750630 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:40.750646 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:46:40.750770 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.750776 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.751937 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.751942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.752595 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:40.752609 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.753346 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.753350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:40.753449 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.753493 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:46:40.753996 (+ 503us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:46:40.754004 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 11:46:40.754084 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 11:46:40.754200 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109}
I20260806 11:46:40.754410 30460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:40.749931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:51275 (local address 127.26.172.194:37265)
0806 11:46:40.750109 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:40.750116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:40.750140 (+ 24us) server_negotiation.cc:407] Connection header received
0806 11:46:40.750308 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:40.750311 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:40.750393 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:40.750497 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:40.750958 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.751761 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.752774 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:40.753164 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:40.753292 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:40.753657 (+ 365us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:40.753795 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:40.753884 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:40.754133 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 11:46:40.754205 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 11:46:40.763170 29999 raft_consensus.cc:1261] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Refusing update from remote peer f82f223f2ab8436b8c398ddfee40894e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:40.763247 30369 raft_consensus.cc:1261] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Refusing update from remote peer f82f223f2ab8436b8c398ddfee40894e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:40.763777 30493 consensus_queue.cc:1035] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:40.763985 30472 consensus_queue.cc:1035] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [LEADER]: Connected to new peer: Peer: permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 11:46:40.787644 30502 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 11:46:42.389077 29774 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:42.389360 29774 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:42.392889 29774 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106: Sending DeleteTablet for 3 replicas of tablet 10d24878b23c44eba1de73e47c8e92b2
I20260806 11:46:42.393807 30342 tablet_service.cc:1514] Processing DeleteTablet for tablet 10d24878b23c44eba1de73e47c8e92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:42 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:34204
I20260806 11:46:42.393828 30140 tablet_service.cc:1514] Processing DeleteTablet for tablet 10d24878b23c44eba1de73e47c8e92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:42 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:47082
I20260806 11:46:42.394248 30576 tablet_replica.cc:330] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f: stopping tablet replica
I20260806 11:46:42.394433 30577 tablet_replica.cc:330] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e: stopping tablet replica
I20260806 11:46:42.394717 30577 raft_consensus.cc:2229] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:46:42.395237 30576 raft_consensus.cc:2229] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:42.395298 30577 raft_consensus.cc:2258] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:42.395433 30576 raft_consensus.cc:2258] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:42.396406 30577 ts_tablet_manager.cc:1905] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:42.397441 29973 tablet_service.cc:1514] Processing DeleteTablet for tablet 10d24878b23c44eba1de73e47c8e92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:42 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:53356
I20260806 11:46:42.398972 30576 ts_tablet_manager.cc:1905] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:42.399362 30579 tablet_replica.cc:330] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a: stopping tablet replica
I20260806 11:46:42.399619 30579 raft_consensus.cc:2229] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:42.399904 30579 raft_consensus.cc:2258] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:42.400914 30579 ts_tablet_manager.cc:1905] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:42.401085 30577 ts_tablet_manager.cc:1918] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 11:46:42.401191 30577 log.cc:1196] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/10d24878b23c44eba1de73e47c8e92b2
I20260806 11:46:42.401582 30577 ts_tablet_manager.cc:1939] T 10d24878b23c44eba1de73e47c8e92b2 P f82f223f2ab8436b8c398ddfee40894e: Deleting consensus metadata
I20260806 11:46:42.402769 29760 catalog_manager.cc:4841] TS f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265): tablet 10d24878b23c44eba1de73e47c8e92b2 (table test-table [id=b9709135719346be8e25c4c0556f50f7]) successfully deleted
I20260806 11:46:42.402943 30576 ts_tablet_manager.cc:1918] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 11:46:42.403047 30576 log.cc:1196] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/10d24878b23c44eba1de73e47c8e92b2
I20260806 11:46:42.403362 30576 ts_tablet_manager.cc:1939] T 10d24878b23c44eba1de73e47c8e92b2 P 294e3a396c6c43fc94ab759400928c9f: Deleting consensus metadata
I20260806 11:46:42.404500 29760 catalog_manager.cc:4841] TS 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619): tablet 10d24878b23c44eba1de73e47c8e92b2 (table test-table [id=b9709135719346be8e25c4c0556f50f7]) successfully deleted
I20260806 11:46:42.405274 30579 ts_tablet_manager.cc:1918] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 11:46:42.405392 30579 log.cc:1196] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/10d24878b23c44eba1de73e47c8e92b2
I20260806 11:46:42.405705 30579 ts_tablet_manager.cc:1939] T 10d24878b23c44eba1de73e47c8e92b2 P 0e69c604312c44938c616a3b51fef24a: Deleting consensus metadata
I20260806 11:46:42.406901 29759 catalog_manager.cc:4841] TS 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417): tablet 10d24878b23c44eba1de73e47c8e92b2 (table test-table [id=b9709135719346be8e25c4c0556f50f7]) successfully deleted
Aug 06 11:46:42 dist-test-slave-7z32 krb5kdc[29710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016802, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 11:46:42 dist-test-slave-7z32 krb5kdc[29710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016802, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:42.447688 30587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:42.430743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57676 (local address 127.26.172.254:33351)
0806 11:46:42.431194 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:42.431202 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:42.431224 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:46:42.431293 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:42.431297 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:42.431357 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:42.431666 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:42.432482 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.433135 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.434215 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.434461 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.434567 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:42.442954 (+ 8387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:42.442961 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:42.442964 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:42.443012 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:42.445242 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:42.445949 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:42.445952 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:42.445953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:42.446049 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:42.446500 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:42.446503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:42.446505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:42.446735 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:42.446973 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:42.447322 (+ 349us) server_negotiation.cc:299] Negotiation successful
0806 11:46:42.447456 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":228,"threads_started":1}
I20260806 11:46:42.452024 29774 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57676:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:46:42.452607 29774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:42.459599 29973 tablet_service.cc:1467] Processing CreateTablet for tablet c0a1e22d776d401c9a7c840d8e165bbf (DEFAULT_TABLE table=test-table [id=d1a4df59b3f14d3292e5a8bd2d78d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:42.459599 30140 tablet_service.cc:1467] Processing CreateTablet for tablet c0a1e22d776d401c9a7c840d8e165bbf (DEFAULT_TABLE table=test-table [id=d1a4df59b3f14d3292e5a8bd2d78d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:42.459717 30342 tablet_service.cc:1467] Processing CreateTablet for tablet c0a1e22d776d401c9a7c840d8e165bbf (DEFAULT_TABLE table=test-table [id=d1a4df59b3f14d3292e5a8bd2d78d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:42.460023 30140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0a1e22d776d401c9a7c840d8e165bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:42.460023 29973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0a1e22d776d401c9a7c840d8e165bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:42.460180 30342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0a1e22d776d401c9a7c840d8e165bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:42.463230 30588 tablet_bootstrap.cc:492] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f: Bootstrap starting.
I20260806 11:46:42.463593 30589 tablet_bootstrap.cc:492] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e: Bootstrap starting.
I20260806 11:46:42.463833 30590 tablet_bootstrap.cc:492] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a: Bootstrap starting.
I20260806 11:46:42.464744 30589 tablet_bootstrap.cc:654] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:42.464829 30588 tablet_bootstrap.cc:654] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:42.465229 30590 tablet_bootstrap.cc:654] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:42.466248 30589 tablet_bootstrap.cc:492] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e: No bootstrap required, opened a new log
I20260806 11:46:42.466380 30589 ts_tablet_manager.cc:1397] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 11:46:42.466858 30588 tablet_bootstrap.cc:492] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f: No bootstrap required, opened a new log
I20260806 11:46:42.466991 30588 ts_tablet_manager.cc:1397] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 11:46:42.466943 30589 raft_consensus.cc:348] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.467097 30589 raft_consensus.cc:374] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:42.467134 30589 raft_consensus.cc:729] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82f223f2ab8436b8c398ddfee40894e, State: Initialized, Role: FOLLOWER
I20260806 11:46:42.467132 30590 tablet_bootstrap.cc:492] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a: No bootstrap required, opened a new log
I20260806 11:46:42.467242 30590 ts_tablet_manager.cc:1397] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260806 11:46:42.467273 30589 consensus_queue.cc:260] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.467610 30589 ts_tablet_manager.cc:1428] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 11:46:42.467563 30588 raft_consensus.cc:348] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.467727 30588 raft_consensus.cc:374] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:42.467773 30588 raft_consensus.cc:729] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 294e3a396c6c43fc94ab759400928c9f, State: Initialized, Role: FOLLOWER
I20260806 11:46:42.467805 30590 raft_consensus.cc:348] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.467928 30590 raft_consensus.cc:374] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:42.467975 30590 raft_consensus.cc:729] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e69c604312c44938c616a3b51fef24a, State: Initialized, Role: FOLLOWER
I20260806 11:46:42.467943 30588 consensus_queue.cc:260] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.468124 30590 consensus_queue.cc:260] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.468452 30588 ts_tablet_manager.cc:1428] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 11:46:42.468619 30590 ts_tablet_manager.cc:1428] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 11:46:42.682602 30597 raft_consensus.cc:482] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:42.682893 30597 raft_consensus.cc:504] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.684737 30597 leader_election.cc:288] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265), 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619)
I20260806 11:46:42.691735 30602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:42.685932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:56967 (local address 127.26.172.195:36619)
0806 11:46:42.686294 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:42.686304 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:42.686319 (+ 15us) server_negotiation.cc:407] Connection header received
0806 11:46:42.686384 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:42.686387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:42.686440 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:42.686551 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:42.686790 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.687593 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.689823 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.690570 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.690767 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:42.690889 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:42.691405 (+ 516us) server_negotiation.cc:299] Negotiation successful
0806 11:46:42.691535 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":140,"threads_started":1}
I20260806 11:46:42.691735 30599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:42.685283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:44049 (local address 127.26.172.194:37265)
0806 11:46:42.685904 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:42.685916 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:42.685938 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:46:42.686024 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:42.686031 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:42.686114 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:42.686251 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:42.686554 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.687486 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.689823 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.690568 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.690884 (+ 316us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:42.690957 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:42.691405 (+ 448us) server_negotiation.cc:299] Negotiation successful
0806 11:46:42.691535 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":243,"threads_started":1}
I20260806 11:46:42.691756 30598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:42.685091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37265 (local address 127.26.172.193:44049)
0806 11:46:42.685615 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:42.685640 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:42.685813 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:42.686256 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:42.686258 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:42.686273 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:42.686411 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:42.686416 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.687710 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.687716 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:42.689580 (+ 1864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:42.689601 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.690868 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.690871 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:42.691143 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:42.691207 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 11:46:42.691327 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 11:46:42.691482 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":312,"thread_start_us":177,"threads_started":1}
I20260806 11:46:42.691756 30601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:42.685608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:36619 (local address 127.26.172.193:56967)
0806 11:46:42.686029 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:42.686041 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:42.686117 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:42.686562 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:42.686564 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:42.686577 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:42.686674 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:42.686678 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.687725 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.687728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:42.689579 (+ 1851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:42.689601 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.690864 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.690869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:42.691139 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:42.691201 (+ 62us) client_negotiation.cc:769] Sending connection context
0806 11:46:42.691330 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 11:46:42.691479 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":374,"thread_start_us":120,"threads_started":1}
I20260806 11:46:42.692653 30185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0a1e22d776d401c9a7c840d8e165bbf" candidate_uuid: "0e69c604312c44938c616a3b51fef24a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82f223f2ab8436b8c398ddfee40894e" is_pre_election: true
I20260806 11:46:42.692909 30185 raft_consensus.cc:2454] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e69c604312c44938c616a3b51fef24a in term 0.
I20260806 11:46:42.692937 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0a1e22d776d401c9a7c840d8e165bbf" candidate_uuid: "0e69c604312c44938c616a3b51fef24a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "294e3a396c6c43fc94ab759400928c9f" is_pre_election: true
I20260806 11:46:42.693315 30369 raft_consensus.cc:2454] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e69c604312c44938c616a3b51fef24a in term 0.
I20260806 11:46:42.693758 29910 leader_election.cc:302] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e69c604312c44938c616a3b51fef24a, f82f223f2ab8436b8c398ddfee40894e; no voters:
I20260806 11:46:42.694228 30597 raft_consensus.cc:2781] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:42.694319 30597 raft_consensus.cc:482] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:42.694350 30597 raft_consensus.cc:3037] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:42.695988 30597 raft_consensus.cc:504] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.696506 30597 leader_election.cc:288] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [CANDIDATE]: Term 1 election: Requested vote from peers f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265), 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619)
I20260806 11:46:42.697494 30369 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0a1e22d776d401c9a7c840d8e165bbf" candidate_uuid: "0e69c604312c44938c616a3b51fef24a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "294e3a396c6c43fc94ab759400928c9f"
I20260806 11:46:42.697634 30185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0a1e22d776d401c9a7c840d8e165bbf" candidate_uuid: "0e69c604312c44938c616a3b51fef24a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82f223f2ab8436b8c398ddfee40894e"
I20260806 11:46:42.697724 30369 raft_consensus.cc:3037] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:42.697918 30185 raft_consensus.cc:3037] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:42.699335 30185 raft_consensus.cc:2454] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e69c604312c44938c616a3b51fef24a in term 1.
I20260806 11:46:42.699436 30369 raft_consensus.cc:2454] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e69c604312c44938c616a3b51fef24a in term 1.
I20260806 11:46:42.699826 29910 leader_election.cc:302] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e69c604312c44938c616a3b51fef24a, f82f223f2ab8436b8c398ddfee40894e; no voters:
I20260806 11:46:42.700212 30597 raft_consensus.cc:2781] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:42.700605 30597 raft_consensus.cc:686] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 1 LEADER]: Becoming Leader. State: Replica: 0e69c604312c44938c616a3b51fef24a, State: Running, Role: LEADER
I20260806 11:46:42.700991 30597 consensus_queue.cc:237] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.705212 29768 catalog_manager.cc:5495] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e69c604312c44938c616a3b51fef24a (127.26.172.193). New cstate: current_term: 1 leader_uuid: "0e69c604312c44938c616a3b51fef24a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } health_report { overall_health: UNKNOWN } } }
I20260806 11:46:42.781845 30608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:42.777222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53370 (local address 127.26.172.193:42417)
0806 11:46:42.777685 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:42.777693 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:42.777707 (+ 14us) server_negotiation.cc:407] Connection header received
0806 11:46:42.777800 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:42.777803 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:42.777874 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:42.778031 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:42.778361 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.779073 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.780056 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.780333 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.780462 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:42.780810 (+ 348us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:42.781351 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:42.781499 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:42.781565 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 11:46:42.781633 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":191,"threads_started":1}
I20260806 11:46:42.798707 30611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:42.793423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37265 (local address 127.26.172.193:46033)
0806 11:46:42.793862 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:42.793878 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:42.793987 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:42.794369 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:42.794372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:42.794380 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:46:42.794513 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:42.794518 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.796039 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.796043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:42.796883 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:42.796899 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.797574 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.797577 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:42.797680 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:42.797755 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:46:42.798325 (+ 570us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:46:42.798333 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 11:46:42.798419 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 11:46:42.798512 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":172,"threads_started":1}
I20260806 11:46:42.798699 30599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:42.793747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:46033 (local address 127.26.172.194:37265)
0806 11:46:42.793913 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:42.793918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:42.793937 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:46:42.794118 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:42.794121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:42.794182 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:42.794289 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:42.795176 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.795838 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.797088 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.797386 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.797506 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:42.797949 (+ 443us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:42.798078 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:42.798306 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:42.798451 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 11:46:42.798536 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 11:46:42.807698 30185 raft_consensus.cc:1261] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Refusing update from remote peer 0e69c604312c44938c616a3b51fef24a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:42.807732 30369 raft_consensus.cc:1261] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Refusing update from remote peer 0e69c604312c44938c616a3b51fef24a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:42.808492 30597 consensus_queue.cc:1035] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:42.808796 30604 consensus_queue.cc:1035] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:42.836318 30621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:42.829566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42417 (local address 127.26.172.194:49557)
0806 11:46:42.831072 (+ 1506us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:42.831092 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:42.831335 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:42.831781 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:42.831784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:42.831793 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:46:42.831931 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:42.831937 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.833131 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.833134 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:42.834262 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:42.834278 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.834922 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.834926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:42.835036 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:42.835084 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:46:42.835939 (+ 855us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:46:42.835950 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 11:46:42.836028 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 11:46:42.836170 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1370,"thread_start_us":126,"threads_started":1}
I20260806 11:46:42.836381 30608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:42.829924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:49557 (local address 127.26.172.193:42417)
0806 11:46:42.830127 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:42.830133 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:42.831237 (+ 1104us) server_negotiation.cc:407] Connection header received
0806 11:46:42.831508 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:42.831512 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:42.831572 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:42.831619 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:42.832090 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.832958 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.834403 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:42.834724 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:42.834923 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:42.835677 (+ 754us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:42.835795 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:42.835910 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:42.836056 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 11:46:42.836131 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 11:46:42.871804 29774 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:42.872102 29774 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:42.875757 29774 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106: Sending DeleteTablet for 3 replicas of tablet c0a1e22d776d401c9a7c840d8e165bbf
I20260806 11:46:42.876852 29973 tablet_service.cc:1514] Processing DeleteTablet for tablet c0a1e22d776d401c9a7c840d8e165bbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:42 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:53356
I20260806 11:46:42.876926 30140 tablet_service.cc:1514] Processing DeleteTablet for tablet c0a1e22d776d401c9a7c840d8e165bbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:42 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:47082
I20260806 11:46:42.876988 30342 tablet_service.cc:1514] Processing DeleteTablet for tablet c0a1e22d776d401c9a7c840d8e165bbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:42 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:34204
I20260806 11:46:42.877146 30579 tablet_replica.cc:330] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a: stopping tablet replica
I20260806 11:46:42.877303 30579 raft_consensus.cc:2229] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:46:42.877358 30577 tablet_replica.cc:330] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e: stopping tablet replica
I20260806 11:46:42.877485 30576 tablet_replica.cc:330] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f: stopping tablet replica
I20260806 11:46:42.877583 30577 raft_consensus.cc:2229] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:42.877650 30576 raft_consensus.cc:2229] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:42.877774 30577 raft_consensus.cc:2258] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:42.877791 30576 raft_consensus.cc:2258] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:42.877786 30579 raft_consensus.cc:2258] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:42.879019 30576 ts_tablet_manager.cc:1905] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:42.879019 30579 ts_tablet_manager.cc:1905] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:42.879460 29774 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57676:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:46:42.880165 29774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:42.882547 30576 ts_tablet_manager.cc:1918] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:46:42.882643 30576 log.cc:1196] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/c0a1e22d776d401c9a7c840d8e165bbf
I20260806 11:46:42.883287 30576 ts_tablet_manager.cc:1939] T c0a1e22d776d401c9a7c840d8e165bbf P 294e3a396c6c43fc94ab759400928c9f: Deleting consensus metadata
I20260806 11:46:42.883678 30579 ts_tablet_manager.cc:1918] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:46:42.883777 30579 log.cc:1196] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/c0a1e22d776d401c9a7c840d8e165bbf
I20260806 11:46:42.884086 30579 ts_tablet_manager.cc:1939] T c0a1e22d776d401c9a7c840d8e165bbf P 0e69c604312c44938c616a3b51fef24a: Deleting consensus metadata
I20260806 11:46:42.884333 30577 ts_tablet_manager.cc:1905] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:42.884977 29759 catalog_manager.cc:4841] TS 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417): tablet c0a1e22d776d401c9a7c840d8e165bbf (table test-table [id=d1a4df59b3f14d3292e5a8bd2d78d1fb]) successfully deleted
I20260806 11:46:42.886791 29760 catalog_manager.cc:4841] TS 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619): tablet c0a1e22d776d401c9a7c840d8e165bbf (table test-table [id=d1a4df59b3f14d3292e5a8bd2d78d1fb]) successfully deleted
I20260806 11:46:42.890008 30577 ts_tablet_manager.cc:1918] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:46:42.890000 29973 tablet_service.cc:1467] Processing CreateTablet for tablet b417007d32964ee0a23ee98adc155c07 (DEFAULT_TABLE table=test-table [id=d4f5415d6f47473eae3a6fec68591ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:42.890174 30577 log.cc:1196] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/c0a1e22d776d401c9a7c840d8e165bbf
I20260806 11:46:42.890513 29973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b417007d32964ee0a23ee98adc155c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:42.890604 30577 ts_tablet_manager.cc:1939] T c0a1e22d776d401c9a7c840d8e165bbf P f82f223f2ab8436b8c398ddfee40894e: Deleting consensus metadata
I20260806 11:46:42.890861 30140 tablet_service.cc:1467] Processing CreateTablet for tablet b417007d32964ee0a23ee98adc155c07 (DEFAULT_TABLE table=test-table [id=d4f5415d6f47473eae3a6fec68591ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:42.891156 30140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b417007d32964ee0a23ee98adc155c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:42.891781 29760 catalog_manager.cc:4841] TS f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265): tablet c0a1e22d776d401c9a7c840d8e165bbf (table test-table [id=d1a4df59b3f14d3292e5a8bd2d78d1fb]) successfully deleted
I20260806 11:46:42.892422 30342 tablet_service.cc:1467] Processing CreateTablet for tablet b417007d32964ee0a23ee98adc155c07 (DEFAULT_TABLE table=test-table [id=d4f5415d6f47473eae3a6fec68591ef8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:42.892795 30342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b417007d32964ee0a23ee98adc155c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:42.893795 30590 tablet_bootstrap.cc:492] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a: Bootstrap starting.
I20260806 11:46:42.894026 30589 tablet_bootstrap.cc:492] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e: Bootstrap starting.
I20260806 11:46:42.895094 30589 tablet_bootstrap.cc:654] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:42.895568 30588 tablet_bootstrap.cc:492] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f: Bootstrap starting.
I20260806 11:46:42.895598 30590 tablet_bootstrap.cc:654] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:42.896797 30589 tablet_bootstrap.cc:492] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e: No bootstrap required, opened a new log
I20260806 11:46:42.896900 30589 ts_tablet_manager.cc:1397] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 11:46:42.896950 30588 tablet_bootstrap.cc:654] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:42.897320 30589 raft_consensus.cc:348] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.897439 30589 raft_consensus.cc:374] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:42.897483 30589 raft_consensus.cc:729] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82f223f2ab8436b8c398ddfee40894e, State: Initialized, Role: FOLLOWER
I20260806 11:46:42.897635 30589 consensus_queue.cc:260] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.897912 30589 ts_tablet_manager.cc:1428] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 11:46:42.899498 30590 tablet_bootstrap.cc:492] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a: No bootstrap required, opened a new log
I20260806 11:46:42.899498 30588 tablet_bootstrap.cc:492] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f: No bootstrap required, opened a new log
I20260806 11:46:42.899652 30590 ts_tablet_manager.cc:1397] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260806 11:46:42.899652 30588 ts_tablet_manager.cc:1397] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 11:46:42.900333 30590 raft_consensus.cc:348] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.900341 30588 raft_consensus.cc:348] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.900522 30590 raft_consensus.cc:374] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:42.900522 30588 raft_consensus.cc:374] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:42.900563 30590 raft_consensus.cc:729] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e69c604312c44938c616a3b51fef24a, State: Initialized, Role: FOLLOWER
I20260806 11:46:42.900563 30588 raft_consensus.cc:729] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 294e3a396c6c43fc94ab759400928c9f, State: Initialized, Role: FOLLOWER
I20260806 11:46:42.900751 30590 consensus_queue.cc:260] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.900751 30588 consensus_queue.cc:260] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:42.901412 30590 ts_tablet_manager.cc:1428] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260806 11:46:42.901396 30588 ts_tablet_manager.cc:1428] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 11:46:43.205396 30596 raft_consensus.cc:482] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:43.205669 30596 raft_consensus.cc:504] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:43.206409 30596 leader_election.cc:288] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417), f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265)
I20260806 11:46:43.207341 29998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b417007d32964ee0a23ee98adc155c07" candidate_uuid: "294e3a396c6c43fc94ab759400928c9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e69c604312c44938c616a3b51fef24a" is_pre_election: true
I20260806 11:46:43.207366 30185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b417007d32964ee0a23ee98adc155c07" candidate_uuid: "294e3a396c6c43fc94ab759400928c9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82f223f2ab8436b8c398ddfee40894e" is_pre_election: true
I20260806 11:46:43.207587 30185 raft_consensus.cc:2454] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 294e3a396c6c43fc94ab759400928c9f in term 0.
I20260806 11:46:43.207587 29998 raft_consensus.cc:2454] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 294e3a396c6c43fc94ab759400928c9f in term 0.
I20260806 11:46:43.208042 30276 leader_election.cc:302] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e69c604312c44938c616a3b51fef24a, 294e3a396c6c43fc94ab759400928c9f; no voters:
I20260806 11:46:43.208361 30596 raft_consensus.cc:2781] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:43.208439 30596 raft_consensus.cc:482] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:43.208482 30596 raft_consensus.cc:3037] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:43.210057 30596 raft_consensus.cc:504] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:43.210606 30596 leader_election.cc:288] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [CANDIDATE]: Term 1 election: Requested vote from peers 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417), f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265)
I20260806 11:46:43.211210 29998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b417007d32964ee0a23ee98adc155c07" candidate_uuid: "294e3a396c6c43fc94ab759400928c9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e69c604312c44938c616a3b51fef24a"
I20260806 11:46:43.211380 29998 raft_consensus.cc:3037] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:43.211422 30185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b417007d32964ee0a23ee98adc155c07" candidate_uuid: "294e3a396c6c43fc94ab759400928c9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82f223f2ab8436b8c398ddfee40894e"
I20260806 11:46:43.211653 30185 raft_consensus.cc:3037] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:43.212757 29998 raft_consensus.cc:2454] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 294e3a396c6c43fc94ab759400928c9f in term 1.
I20260806 11:46:43.213119 30185 raft_consensus.cc:2454] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 294e3a396c6c43fc94ab759400928c9f in term 1.
I20260806 11:46:43.213263 30276 leader_election.cc:302] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e69c604312c44938c616a3b51fef24a, 294e3a396c6c43fc94ab759400928c9f; no voters:
I20260806 11:46:43.213574 30596 raft_consensus.cc:2781] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:43.213795 30596 raft_consensus.cc:686] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 1 LEADER]: Becoming Leader. State: Replica: 294e3a396c6c43fc94ab759400928c9f, State: Running, Role: LEADER
I20260806 11:46:43.214040 30596 consensus_queue.cc:237] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } }
I20260806 11:46:43.216084 29774 catalog_manager.cc:5495] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 294e3a396c6c43fc94ab759400928c9f (127.26.172.195). New cstate: current_term: 1 leader_uuid: "294e3a396c6c43fc94ab759400928c9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "294e3a396c6c43fc94ab759400928c9f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 36619 } health_report { overall_health: HEALTHY } } }
I20260806 11:46:43.299002 30631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:43.294125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34222 (local address 127.26.172.195:36619)
0806 11:46:43.294505 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:43.294514 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:43.294530 (+ 16us) server_negotiation.cc:407] Connection header received
0806 11:46:43.294596 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:43.294599 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:43.294659 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:43.294776 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:43.295253 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:43.296021 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:43.297190 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:43.297473 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:43.297594 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:43.298000 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:43.298370 (+ 370us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:43.298456 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:43.298633 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 11:46:43.298729 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":189,"threads_started":1}
I20260806 11:46:43.308830 29998 raft_consensus.cc:1261] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Refusing update from remote peer 294e3a396c6c43fc94ab759400928c9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:43.308959 30185 raft_consensus.cc:1261] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Refusing update from remote peer 294e3a396c6c43fc94ab759400928c9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:43.309463 30627 consensus_queue.cc:1035] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e69c604312c44938c616a3b51fef24a" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:43.309733 30596 consensus_queue.cc:1035] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82f223f2ab8436b8c398ddfee40894e" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 11:46:43.329385 30551 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 11:46:44.909015 29774 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:44.909231 29774 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:44.914049 29774 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 820c1e7c292d4df68f3993af23614106: Sending DeleteTablet for 3 replicas of tablet b417007d32964ee0a23ee98adc155c07
I20260806 11:46:44.915177 30342 tablet_service.cc:1514] Processing DeleteTablet for tablet b417007d32964ee0a23ee98adc155c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:44 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:34204
I20260806 11:46:44.915176 29973 tablet_service.cc:1514] Processing DeleteTablet for tablet b417007d32964ee0a23ee98adc155c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:44 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:53356
I20260806 11:46:44.915467 30140 tablet_service.cc:1514] Processing DeleteTablet for tablet b417007d32964ee0a23ee98adc155c07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:44 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:47082
I20260806 11:46:44.915735 30672 tablet_replica.cc:330] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f: stopping tablet replica
I20260806 11:46:44.915777 30670 tablet_replica.cc:330] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a: stopping tablet replica
I20260806 11:46:44.915895 30672 raft_consensus.cc:2229] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:46:44.915977 30670 raft_consensus.cc:2229] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:44.916184 30673 tablet_replica.cc:330] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e: stopping tablet replica
I20260806 11:46:44.916205 30670 raft_consensus.cc:2258] T b417007d32964ee0a23ee98adc155c07 P 0e69c604312c44938c616a3b51fef24a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:44.916446 30672 raft_consensus.cc:2258] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:44.916498 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 29883
I20260806 11:46:44.942451 30673 raft_consensus.cc:2229] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:44.942868 30673 raft_consensus.cc:2258] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:44.943663 30672 ts_tablet_manager.cc:1905] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:44.943904 30673 ts_tablet_manager.cc:1905] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:44.946735 30672 ts_tablet_manager.cc:1918] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 11:46:44.946902 30672 log.cc:1196] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/b417007d32964ee0a23ee98adc155c07
I20260806 11:46:44.947228 30672 ts_tablet_manager.cc:1939] T b417007d32964ee0a23ee98adc155c07 P 294e3a396c6c43fc94ab759400928c9f: Deleting consensus metadata
I20260806 11:46:44.948171 29760 catalog_manager.cc:4841] TS 294e3a396c6c43fc94ab759400928c9f (127.26.172.195:36619): tablet b417007d32964ee0a23ee98adc155c07 (table test-table [id=d4f5415d6f47473eae3a6fec68591ef8]) successfully deleted
I20260806 11:46:44.948606 30673 ts_tablet_manager.cc:1918] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 11:46:44.948750 30673 log.cc:1196] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/b417007d32964ee0a23ee98adc155c07
I20260806 11:46:44.949069 30673 ts_tablet_manager.cc:1939] T b417007d32964ee0a23ee98adc155c07 P f82f223f2ab8436b8c398ddfee40894e: Deleting consensus metadata
I20260806 11:46:44.950875 29760 catalog_manager.cc:4841] TS f82f223f2ab8436b8c398ddfee40894e (127.26.172.194:37265): tablet b417007d32964ee0a23ee98adc155c07 (table test-table [id=d4f5415d6f47473eae3a6fec68591ef8]) successfully deleted
W20260806 11:46:44.957019 29759 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:42417 (error 108)
I20260806 11:46:44.957479 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 30069
I20260806 11:46:44.964001 30675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:44.961243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42417 (local address 127.0.0.1:53384)
0806 11:46:44.963721 (+ 2478us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:44.963852 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:42417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2351,"thread_start_us":158,"threads_started":1}
W20260806 11:46:44.964357 29759 catalog_manager.cc:4584] TS 0e69c604312c44938c616a3b51fef24a (127.26.172.193:42417): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b417007d32964ee0a23ee98adc155c07: Network error: Client connection negotiation failed: client connection to 127.26.172.193:42417: connect: Connection refused (error 111)
I20260806 11:46:44.975754 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 30256
I20260806 11:46:44.997617 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 29735
2026-08-06T11:46:45Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8052 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:46:45 dist-test-slave-7z32 krb5kdc[30683](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:46:45 dist-test-slave-7z32 krb5kdc[30683](info): set up 2 sockets
Aug 06 11:46:45 dist-test-slave-7z32 krb5kdc[30683](info): commencing operation
krb5kdc: starting...
W20260806 11:46:46.341058 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.299s user 0.004s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:46:46 dist-test-slave-7z32 krb5kdc[30683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:46:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:46:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:46:46.524667 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:32843
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:32843
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:46.660867 30702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:46.661258 30702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:46.661337 30702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:46.666131 30702 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:46:46.666347 30702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:46.666405 30702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:46.666451 30702 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:46:46.666497 30702 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:46:46.673424 30702 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:32843
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:32843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:46.675007 30702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:46.676276 30702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:46.687670 30711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:46.687753 30708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:46.687940 30702 server_base.cc:1034] running on GCE node
W20260806 11:46:46.687774 30707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:46.689000 30702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:46.690644 30702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:46.692026 30702 hybrid_clock.cc:648] HybridClock initialized: now 1786016806691975 us; error 67 us; skew 500 ppm
Aug 06 11:46:46 dist-test-slave-7z32 krb5kdc[30683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016806, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:46.697018 30702 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:46:46.698798 30702 webserver.cc:460] Webserver started at http://127.26.172.254:35431/ using document root <none> and password file <none>
I20260806 11:46:46.699862 30702 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:46.700001 30702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:46.700341 30702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:46.703543 30702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "a8a5494f7d7b49718b7648296fdd86e1"
format_stamp: "Formatted at 2026-08-06 11:46:46 on dist-test-slave-7z32"
server_key: "9264b40041cb0c89fc4909e8b594f059"
server_key_iv: "a14266faa5e3778bca34fe68a4d6f680"
server_key_version: "encryptionkey@0"
I20260806 11:46:46.704453 30702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "a8a5494f7d7b49718b7648296fdd86e1"
format_stamp: "Formatted at 2026-08-06 11:46:46 on dist-test-slave-7z32"
server_key: "9264b40041cb0c89fc4909e8b594f059"
server_key_iv: "a14266faa5e3778bca34fe68a4d6f680"
server_key_version: "encryptionkey@0"
I20260806 11:46:46.710506 30702 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 11:46:46.715355 30725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:46.717613 30702 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:46:46.717923 30702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "a8a5494f7d7b49718b7648296fdd86e1"
format_stamp: "Formatted at 2026-08-06 11:46:46 on dist-test-slave-7z32"
server_key: "9264b40041cb0c89fc4909e8b594f059"
server_key_iv: "a14266faa5e3778bca34fe68a4d6f680"
server_key_version: "encryptionkey@0"
I20260806 11:46:46.718156 30702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:46.735241 30702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:46.740458 30702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:46.740813 30702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:46.752271 30702 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:32843
I20260806 11:46:46.752390 30796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:32843 every 8 connection(s)
I20260806 11:46:46.753851 30702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:46:46.757146 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 30702
I20260806 11:46:46.757300 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:46:46.757683 27315 external_mini_cluster.cc:1428] Setting key b84e9e2a6be126a3d66323c29fbeda73
I20260806 11:46:46.758561 30798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:46.767774 30798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1: Bootstrap starting.
I20260806 11:46:46.771090 30798 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:46.772220 30798 log.cc:824] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1: Log is configured to *not* fsync() on all Append() calls
Aug 06 11:46:46 dist-test-slave-7z32 krb5kdc[30683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:46.776125 30798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1: No bootstrap required, opened a new log
I20260806 11:46:46.781785 30798 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5494f7d7b49718b7648296fdd86e1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32843 } }
I20260806 11:46:46.782123 30798 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:46.782166 30798 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8a5494f7d7b49718b7648296fdd86e1, State: Initialized, Role: FOLLOWER
I20260806 11:46:46.782459 30801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:46.760123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49614 (local address 127.26.172.254:32843)
0806 11:46:46.760872 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:46.760897 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:46.760957 (+ 60us) server_negotiation.cc:407] Connection header received
0806 11:46:46.762493 (+ 1536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:46.762526 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:46.763274 (+ 748us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:46.763839 (+ 565us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:46.765096 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:46.766816 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:46.768287 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:46.769074 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:46.769312 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:46.773882 (+ 4570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:46.773892 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:46.773920 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:46.773966 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:46.777021 (+ 3055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:46.777884 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:46.777893 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:46.777901 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:46.778171 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:46.778641 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:46.778644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:46.778646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:46.779422 (+ 776us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:46.779646 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:46.780283 (+ 637us) server_negotiation.cc:299] Negotiation successful
0806 11:46:46.780833 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":214,"threads_started":1}
I20260806 11:46:46.782948 30798 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5494f7d7b49718b7648296fdd86e1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32843 } }
I20260806 11:46:46.783157 30798 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:46:46.783272 30798 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:46:46.783438 30798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:46.784639 30798 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5494f7d7b49718b7648296fdd86e1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32843 } }
I20260806 11:46:46.785094 30798 leader_election.cc:302] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8a5494f7d7b49718b7648296fdd86e1; no voters:
I20260806 11:46:46.785537 30798 leader_election.cc:288] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:46:46.785641 30803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:46.785856 30803 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [term 1 LEADER]: Becoming Leader. State: Replica: a8a5494f7d7b49718b7648296fdd86e1, State: Running, Role: LEADER
I20260806 11:46:46.786367 30803 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5494f7d7b49718b7648296fdd86e1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32843 } }
I20260806 11:46:46.787252 30798 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:46:46.788743 30806 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8a5494f7d7b49718b7648296fdd86e1. Latest consensus state: current_term: 1 leader_uuid: "a8a5494f7d7b49718b7648296fdd86e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5494f7d7b49718b7648296fdd86e1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32843 } } }
I20260806 11:46:46.788800 30804 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8a5494f7d7b49718b7648296fdd86e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5494f7d7b49718b7648296fdd86e1" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32843 } } }
I20260806 11:46:46.789007 30806 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:46.789006 30804 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1 [sys.catalog]: This master's current role is: LEADER
W20260806 11:46:46.794413 30828 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:46:46.794546 30828 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:46:46.794668 30820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:46:46.795737 30820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:46:46.805089 30820 catalog_manager.cc:1347] Generated new cluster ID: e886850a223741b59f6ce1e2dd46e613
I20260806 11:46:46.805338 30820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:46:46.828913 30820 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:46:46.830531 30820 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:46:46.836927 30820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8a5494f7d7b49718b7648296fdd86e1: Generated new TSK 0
I20260806 11:46:46.837926 30820 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:46:46.883860 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:32843
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:47.043023 30834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:47.043462 30834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:47.043548 30834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:47.048175 30834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:47.048322 30834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:47.048441 30834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:46:47.055944 30834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:32843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:47.058029 30834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:47.059830 30834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:47.074747 30843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:47.074752 30839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:47.074805 30841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:47.075249 30834 server_base.cc:1034] running on GCE node
I20260806 11:46:47.076035 30834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:47.076933 30834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:47.078193 30834 hybrid_clock.cc:648] HybridClock initialized: now 1786016807078152 us; error 64 us; skew 500 ppm
Aug 06 11:46:47 dist-test-slave-7z32 krb5kdc[30683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016807, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:47.082150 30834 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:46:47.083518 30834 webserver.cc:460] Webserver started at http://127.26.172.193:36397/ using document root <none> and password file <none>
I20260806 11:46:47.084245 30834 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:47.084321 30834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:47.084543 30834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:47.087471 30834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "022d0a2d545c4b94a44abc33df719247"
format_stamp: "Formatted at 2026-08-06 11:46:47 on dist-test-slave-7z32"
server_key: "dc252eca9e0c49fd661d07c825e0783e"
server_key_iv: "0865bd50b3b299f5ff61b5a474da1a47"
server_key_version: "encryptionkey@0"
I20260806 11:46:47.088250 30834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "022d0a2d545c4b94a44abc33df719247"
format_stamp: "Formatted at 2026-08-06 11:46:47 on dist-test-slave-7z32"
server_key: "dc252eca9e0c49fd661d07c825e0783e"
server_key_iv: "0865bd50b3b299f5ff61b5a474da1a47"
server_key_version: "encryptionkey@0"
I20260806 11:46:47.093865 30834 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:46:47.097697 30856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:47.099781 30834 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 11:46:47.099956 30834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "022d0a2d545c4b94a44abc33df719247"
format_stamp: "Formatted at 2026-08-06 11:46:47 on dist-test-slave-7z32"
server_key: "dc252eca9e0c49fd661d07c825e0783e"
server_key_iv: "0865bd50b3b299f5ff61b5a474da1a47"
server_key_version: "encryptionkey@0"
I20260806 11:46:47.100157 30834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:47.119427 30834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:47.123953 30834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:47.124230 30834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:47.125039 30834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:47.126160 30834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:47.126228 30834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:47.126276 30834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:47.126302 30834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:47.140089 30834 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:33493
I20260806 11:46:47.140229 31002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:33493 every 8 connection(s)
I20260806 11:46:47.141325 30834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:46:47.146929 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 30834
I20260806 11:46:47.147329 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:46:47.147900 27315 external_mini_cluster.cc:1428] Setting key f60f04e0b42663d74c372de20fca5214
Aug 06 11:46:47 dist-test-slave-7z32 krb5kdc[30683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016807, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:46:47.163769 30801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:47.144397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:32813 (local address 127.26.172.254:32843)
0806 11:46:47.144625 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:47.144631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:47.146115 (+ 1484us) server_negotiation.cc:407] Connection header received
0806 11:46:47.147924 (+ 1809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:47.147931 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:47.148036 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:47.148199 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:47.150399 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.151464 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.152975 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.153509 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.153640 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:47.158227 (+ 4587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:47.158232 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:47.158234 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:47.158295 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:47.160497 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:47.161386 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:47.161391 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:47.161393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:47.161503 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:47.162001 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:47.162005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:47.162007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:47.162278 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:47.162404 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:47.163258 (+ 854us) server_negotiation.cc:299] Negotiation successful
0806 11:46:47.163475 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 11:46:47.165603 31008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:47.145092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:32843 (local address 127.26.172.193:32813)
0806 11:46:47.145874 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:47.145940 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:47.147588 (+ 1648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:47.148496 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:47.148506 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:47.149152 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:47.149761 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:47.149812 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.151698 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.151701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:47.152781 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:47.152796 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.153768 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.153776 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:47.154124 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:47.155142 (+ 1018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:47.155169 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:47.157892 (+ 2723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:47.160732 (+ 2840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:47.160747 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:47.160783 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:47.161241 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:47.161667 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:47.161671 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:47.161673 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:47.161879 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:47.162403 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:47.162416 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:47.162940 (+ 524us) client_negotiation.cc:769] Sending connection context
0806 11:46:47.163212 (+ 272us) client_negotiation.cc:240] Negotiation successful
0806 11:46:47.163831 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":196,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:46:47.167802 31005 heartbeater.cc:347] Connected to a master server at 127.26.172.254:32843
I20260806 11:46:47.168280 31005 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:47.169103 31005 heartbeater.cc:511] Master 127.26.172.254:32843 requested a full tablet report, sending...
I20260806 11:46:47.171574 30753 ts_manager.cc:194] Registered new tserver with Master: 022d0a2d545c4b94a44abc33df719247 (127.26.172.193:33493)
I20260806 11:46:47.172902 30753 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:32813
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:46:47.192015 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:32843
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:47.326977 31011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:47.327363 31011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:47.327452 31011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:47.332571 31011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:47.332710 31011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:47.332815 31011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:46:47.339404 31011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:32843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:47.340766 31011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:47.342700 31011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:47.357519 31021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:47.357684 31017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:47.357684 31019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:47.358330 31011 server_base.cc:1034] running on GCE node
I20260806 11:46:47.359087 31011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:47.360060 31011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:47.361321 31011 hybrid_clock.cc:648] HybridClock initialized: now 1786016807361293 us; error 48 us; skew 500 ppm
Aug 06 11:46:47 dist-test-slave-7z32 krb5kdc[30683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016807, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:47.365770 31011 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:46:47.367398 31011 webserver.cc:460] Webserver started at http://127.26.172.194:34305/ using document root <none> and password file <none>
I20260806 11:46:47.368495 31011 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:47.368750 31011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:47.369093 31011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:47.372139 31011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "dea0fa32131a45619501e6c21babfc69"
format_stamp: "Formatted at 2026-08-06 11:46:47 on dist-test-slave-7z32"
server_key: "6ff27c1295fdd2c25b06ee7118357f88"
server_key_iv: "413c7a5d41958636c30123afe8e9d633"
server_key_version: "encryptionkey@0"
I20260806 11:46:47.372933 31011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "dea0fa32131a45619501e6c21babfc69"
format_stamp: "Formatted at 2026-08-06 11:46:47 on dist-test-slave-7z32"
server_key: "6ff27c1295fdd2c25b06ee7118357f88"
server_key_iv: "413c7a5d41958636c30123afe8e9d633"
server_key_version: "encryptionkey@0"
I20260806 11:46:47.378656 31011 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:46:47.383050 31030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:47.384979 31011 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:46:47.385232 31011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "dea0fa32131a45619501e6c21babfc69"
format_stamp: "Formatted at 2026-08-06 11:46:47 on dist-test-slave-7z32"
server_key: "6ff27c1295fdd2c25b06ee7118357f88"
server_key_iv: "413c7a5d41958636c30123afe8e9d633"
server_key_version: "encryptionkey@0"
I20260806 11:46:47.385422 31011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:47.448081 31011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:47.452968 31011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:47.453296 31011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:47.454213 31011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:47.455569 31011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:47.455652 31011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:47.455721 31011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:47.455754 31011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:47.469571 31011 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:43047
I20260806 11:46:47.469610 31169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:43047 every 8 connection(s)
I20260806 11:46:47.471038 31011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:46:47.475471 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 31011
I20260806 11:46:47.475708 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:46:47.476274 27315 external_mini_cluster.cc:1428] Setting key 45d85638bfd7f8e8712cc45b321f55a2
Aug 06 11:46:47 dist-test-slave-7z32 krb5kdc[30683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016807, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:46:47.493569 30801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:47.473556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:34093 (local address 127.26.172.254:32843)
0806 11:46:47.473767 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:47.473772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:47.475069 (+ 1297us) server_negotiation.cc:407] Connection header received
0806 11:46:47.477546 (+ 2477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:47.477551 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:47.477636 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:47.477760 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:47.480411 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.480997 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.483144 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.483568 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.483737 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:47.487954 (+ 4217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:47.487962 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:47.487968 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:47.488057 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:47.490218 (+ 2161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:47.491259 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:47.491263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:47.491264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:47.491372 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:47.491893 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:47.491901 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:47.491903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:47.492301 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:47.492433 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:47.493144 (+ 711us) server_negotiation.cc:299] Negotiation successful
0806 11:46:47.493344 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":71}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:46:47.495304 31172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:47.473985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:32843 (local address 127.26.172.194:34093)
0806 11:46:47.474740 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:47.474817 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:47.477135 (+ 2318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:47.478029 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:47.478038 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:47.478811 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:47.480079 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:47.480119 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.481209 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.481217 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:47.482811 (+ 1594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:47.482956 (+ 145us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.483855 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.483858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:47.484168 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:47.485113 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:47.485137 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:47.487592 (+ 2455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:47.490434 (+ 2842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:47.490446 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:47.490481 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:47.491113 (+ 632us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:47.491488 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:47.491492 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:47.491494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:47.491782 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:47.492433 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:47.492445 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:47.492835 (+ 390us) client_negotiation.cc:769] Sending connection context
0806 11:46:47.493090 (+ 255us) client_negotiation.cc:240] Negotiation successful
0806 11:46:47.493594 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":161,"threads_started":1}
I20260806 11:46:47.497172 31170 heartbeater.cc:347] Connected to a master server at 127.26.172.254:32843
I20260806 11:46:47.497627 31170 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:47.498417 31170 heartbeater.cc:511] Master 127.26.172.254:32843 requested a full tablet report, sending...
I20260806 11:46:47.500329 30753 ts_manager.cc:194] Registered new tserver with Master: dea0fa32131a45619501e6c21babfc69 (127.26.172.194:43047)
I20260806 11:46:47.501165 30753 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:34093
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:46:47.518245 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:32843
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:47.656960 31176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:47.657342 31176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:47.657390 31176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:47.662089 31176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:47.662195 31176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:47.662261 31176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:46:47.668645 31176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:32843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:47.670233 31176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:47.671736 31176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:47.685312 31185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:47.685312 31182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:47.685282 31183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:47.685860 31176 server_base.cc:1034] running on GCE node
I20260806 11:46:47.686458 31176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:47.687383 31176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:47.688954 31176 hybrid_clock.cc:648] HybridClock initialized: now 1786016807688937 us; error 55 us; skew 500 ppm
Aug 06 11:46:47 dist-test-slave-7z32 krb5kdc[30683](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016807, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:47.693662 31176 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:46:47.695068 31176 webserver.cc:460] Webserver started at http://127.26.172.195:36221/ using document root <none> and password file <none>
I20260806 11:46:47.695873 31176 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:47.695974 31176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:47.696195 31176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:47.698760 31176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "89ede4ae42754f90b50ee4e9a54e4912"
format_stamp: "Formatted at 2026-08-06 11:46:47 on dist-test-slave-7z32"
server_key: "52f12b2f9b04781d40dd0379003bd3c4"
server_key_iv: "508d8b63db7f71c7da36b34571f00af1"
server_key_version: "encryptionkey@0"
I20260806 11:46:47.699566 31176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "89ede4ae42754f90b50ee4e9a54e4912"
format_stamp: "Formatted at 2026-08-06 11:46:47 on dist-test-slave-7z32"
server_key: "52f12b2f9b04781d40dd0379003bd3c4"
server_key_iv: "508d8b63db7f71c7da36b34571f00af1"
server_key_version: "encryptionkey@0"
I20260806 11:46:47.705431 31176 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260806 11:46:47.709589 31197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:47.712003 31176 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:46:47.712270 31176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "89ede4ae42754f90b50ee4e9a54e4912"
format_stamp: "Formatted at 2026-08-06 11:46:47 on dist-test-slave-7z32"
server_key: "52f12b2f9b04781d40dd0379003bd3c4"
server_key_iv: "508d8b63db7f71c7da36b34571f00af1"
server_key_version: "encryptionkey@0"
I20260806 11:46:47.712457 31176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:47.733606 31176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:47.737834 31176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:47.738112 31176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:47.738903 31176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:47.739953 31176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:47.740053 31176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:47.740132 31176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:47.740180 31176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:47.752180 31176 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:39555
I20260806 11:46:47.752202 31355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:39555 every 8 connection(s)
I20260806 11:46:47.753340 31176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:46:47.760851 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 31176
I20260806 11:46:47.761046 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:46:47.761499 27315 external_mini_cluster.cc:1428] Setting key 78db0105b12e52376af729532a11f9ee
Aug 06 11:46:47 dist-test-slave-7z32 krb5kdc[30683](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016807, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:47.773880 30801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:47.756188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:37839 (local address 127.26.172.254:32843)
0806 11:46:47.756410 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:47.756416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:47.757707 (+ 1291us) server_negotiation.cc:407] Connection header received
0806 11:46:47.760240 (+ 2533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:47.760245 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:47.760385 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:47.760580 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:47.762596 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.763500 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.765369 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.765634 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.765779 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:47.769174 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:47.769178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:47.769180 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:47.769211 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:47.771221 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:47.771946 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:47.771950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:47.771952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:47.772052 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:47.772490 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:47.772494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:47.772496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:47.772735 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:47.772866 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:47.773510 (+ 644us) server_negotiation.cc:299] Negotiation successful
0806 11:46:47.773674 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 11:46:47.775344 31360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:47.756685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:32843 (local address 127.26.172.195:37839)
0806 11:46:47.757409 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:47.757491 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:47.759818 (+ 2327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:47.760907 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:47.760919 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:47.761512 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:47.762392 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:47.762418 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.763675 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.763686 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:47.765199 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:47.765213 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:47.765848 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:47.765853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:47.766060 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:47.767104 (+ 1044us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:47.767125 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:47.768929 (+ 1804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:47.771412 (+ 2483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:47.771429 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:47.771449 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:47.771800 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:47.772167 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:47.772171 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:47.772173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:47.772361 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:47.772864 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:47.772885 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:47.773217 (+ 332us) client_negotiation.cc:769] Sending connection context
0806 11:46:47.773462 (+ 245us) client_negotiation.cc:240] Negotiation successful
0806 11:46:47.773914 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":142,"threads_started":1}
I20260806 11:46:47.777338 31358 heartbeater.cc:347] Connected to a master server at 127.26.172.254:32843
I20260806 11:46:47.777837 31358 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:47.778818 31358 heartbeater.cc:511] Master 127.26.172.254:32843 requested a full tablet report, sending...
I20260806 11:46:47.780594 30753 ts_manager.cc:194] Registered new tserver with Master: 89ede4ae42754f90b50ee4e9a54e4912 (127.26.172.195:39555)
I20260806 11:46:47.781441 30753 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:37839
I20260806 11:46:47.793104 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 11:46:47.816764 30801 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:46:47.814667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49620 (local address 127.26.172.254:32843)
0806 11:46:47.814940 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:47.814945 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:47.815162 (+ 217us) server_negotiation.cc:407] Connection header received
0806 11:46:47.815300 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:47.815304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:47.815369 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:47.815456 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:47.816464 (+ 1008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49620: BlockingRecv error: recv got EOF from 127.0.0.1:49620 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
I20260806 11:46:47.818621 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 30834
I20260806 11:46:47.852440 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 31011
I20260806 11:46:47.874396 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 31176
I20260806 11:46:47.895447 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 30702
2026-08-06T11:46:47Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2887 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:46:47 dist-test-slave-7z32 krb5kdc[31375](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:46:47 dist-test-slave-7z32 krb5kdc[31375](info): set up 2 sockets
Aug 06 11:46:47 dist-test-slave-7z32 krb5kdc[31375](info): commencing operation
krb5kdc: starting...
W20260806 11:46:49.252370 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:46:49 dist-test-slave-7z32 krb5kdc[31375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:46:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:46:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:46:49.443670 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:42955
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:42955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:49.609508 31395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:49.610240 31395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:49.610365 31395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:49.615829 31395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:46:49.615962 31395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:49.615984 31395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:49.616004 31395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:46:49.616021 31395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:46:49.623188 31395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:42955
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:42955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:49.624902 31395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:49.626727 31395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:49.639366 31403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:49.640985 31402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:49.641346 31395 server_base.cc:1034] running on GCE node
W20260806 11:46:49.641580 31405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:49.642501 31395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:49.644182 31395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:49.647655 31395 hybrid_clock.cc:648] HybridClock initialized: now 1786016809647593 us; error 83 us; skew 500 ppm
Aug 06 11:46:49 dist-test-slave-7z32 krb5kdc[31375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016809, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:49.651685 31395 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:46:49.653143 31395 webserver.cc:460] Webserver started at http://127.26.172.254:46815/ using document root <none> and password file <none>
I20260806 11:46:49.653975 31395 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:49.654062 31395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:49.654366 31395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:49.657250 31395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "555ca7b138db44bc9e0dac13ba884121"
format_stamp: "Formatted at 2026-08-06 11:46:49 on dist-test-slave-7z32"
server_key: "f492fa5a145f60b67df6a223c25276c5"
server_key_iv: "a28298932f8efacf7eaad4ca5294db27"
server_key_version: "encryptionkey@0"
I20260806 11:46:49.658032 31395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "555ca7b138db44bc9e0dac13ba884121"
format_stamp: "Formatted at 2026-08-06 11:46:49 on dist-test-slave-7z32"
server_key: "f492fa5a145f60b67df6a223c25276c5"
server_key_iv: "a28298932f8efacf7eaad4ca5294db27"
server_key_version: "encryptionkey@0"
I20260806 11:46:49.663513 31395 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 11:46:49.667273 31413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:49.669428 31395 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:46:49.669629 31395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "555ca7b138db44bc9e0dac13ba884121"
format_stamp: "Formatted at 2026-08-06 11:46:49 on dist-test-slave-7z32"
server_key: "f492fa5a145f60b67df6a223c25276c5"
server_key_iv: "a28298932f8efacf7eaad4ca5294db27"
server_key_version: "encryptionkey@0"
I20260806 11:46:49.669847 31395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:49.694257 31395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:49.699097 31395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:49.699366 31395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:49.710041 31395 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:42955
I20260806 11:46:49.710090 31478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:42955 every 8 connection(s)
I20260806 11:46:49.711426 31395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:46:49.716019 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 31395
I20260806 11:46:49.716009 31480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:49.716167 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:46:49.716637 27315 external_mini_cluster.cc:1428] Setting key deb8d0703e754a9c57dc8809e8785cef
I20260806 11:46:49.726540 31480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121: Bootstrap starting.
Aug 06 11:46:49 dist-test-slave-7z32 krb5kdc[31375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:49.730248 31480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:49.731575 31480 log.cc:824] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:49.735002 31480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121: No bootstrap required, opened a new log
I20260806 11:46:49.738360 31484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:49.718747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43626 (local address 127.26.172.254:42955)
0806 11:46:49.719483 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:49.719521 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:49.719598 (+ 77us) server_negotiation.cc:407] Connection header received
0806 11:46:49.720994 (+ 1396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:49.721032 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:49.721716 (+ 684us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:49.722272 (+ 556us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:49.723526 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:49.725187 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:49.726371 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:49.727183 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:49.727402 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:49.731351 (+ 3949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:49.731361 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:49.731390 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:49.731450 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:49.733774 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:49.734943 (+ 1169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:49.734962 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:49.734974 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:49.735287 (+ 313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:49.735744 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:49.735748 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:49.735750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:49.736345 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:49.736600 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:49.736970 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 11:46:49.737361 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":163,"threads_started":1}
I20260806 11:46:49.740978 31480 raft_consensus.cc:348] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555ca7b138db44bc9e0dac13ba884121" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42955 } }
I20260806 11:46:49.741488 31480 raft_consensus.cc:374] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:49.741568 31480 raft_consensus.cc:729] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 555ca7b138db44bc9e0dac13ba884121, State: Initialized, Role: FOLLOWER
I20260806 11:46:49.742213 31480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555ca7b138db44bc9e0dac13ba884121" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42955 } }
I20260806 11:46:49.742442 31480 raft_consensus.cc:388] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:46:49.742561 31480 raft_consensus.cc:482] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:46:49.742704 31480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:49.743372 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:46:49.744551 31480 raft_consensus.cc:504] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555ca7b138db44bc9e0dac13ba884121" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42955 } }
I20260806 11:46:49.745138 31480 leader_election.cc:302] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 555ca7b138db44bc9e0dac13ba884121; no voters:
I20260806 11:46:49.745687 31480 leader_election.cc:288] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:46:49.745997 31486 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:49.746505 31486 raft_consensus.cc:686] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [term 1 LEADER]: Becoming Leader. State: Replica: 555ca7b138db44bc9e0dac13ba884121, State: Running, Role: LEADER
I20260806 11:46:49.747057 31486 consensus_queue.cc:237] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555ca7b138db44bc9e0dac13ba884121" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42955 } }
I20260806 11:46:49.748142 31480 sys_catalog.cc:564] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:46:49.749557 31487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "555ca7b138db44bc9e0dac13ba884121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555ca7b138db44bc9e0dac13ba884121" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42955 } } }
I20260806 11:46:49.749557 31488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 555ca7b138db44bc9e0dac13ba884121. Latest consensus state: current_term: 1 leader_uuid: "555ca7b138db44bc9e0dac13ba884121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "555ca7b138db44bc9e0dac13ba884121" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42955 } } }
I20260806 11:46:49.749770 31487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:49.749770 31488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:49.750332 31500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:46:49.754904 31500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:46:49.763131 31500 catalog_manager.cc:1347] Generated new cluster ID: 8de154dd5af347e2b898bc194c05d5de
I20260806 11:46:49.763259 31500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:46:49.772923 31500 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:46:49.774377 31500 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:46:49.779536 31484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:49.771751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43638 (local address 127.26.172.254:42955)
0806 11:46:49.771895 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:49.771900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:49.772405 (+ 505us) server_negotiation.cc:407] Connection header received
0806 11:46:49.772609 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:49.772613 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:49.772675 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:49.772792 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:49.773688 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:49.774588 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:49.776276 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:49.776688 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:49.776825 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:49.778103 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:49.778107 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:49.778110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:49.778794 (+ 684us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:49.778870 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:49.778904 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:49.779023 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:49.779184 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 11:46:49.779283 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 11:46:49.781368 31500 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 555ca7b138db44bc9e0dac13ba884121: Generated new TSK 0
I20260806 11:46:49.782228 31500 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:46:49.793526 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 31395
2026-08-06T11:46:49Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1898 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:46:49 dist-test-slave-7z32 krb5kdc[31525](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:46:49 dist-test-slave-7z32 krb5kdc[31525](info): set up 2 sockets
Aug 06 11:46:49 dist-test-slave-7z32 krb5kdc[31525](info): commencing operation
krb5kdc: starting...
W20260806 11:46:51.126542 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.001s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:46:51 dist-test-slave-7z32 krb5kdc[31525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:46:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:46:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:46:51.302881 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:35303
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:35303
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:51.471818 31544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:51.472436 31544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:51.472549 31544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:51.480954 31544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:46:51.481150 31544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:51.481196 31544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:51.481251 31544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:46:51.481302 31544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:46:51.490808 31544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:35303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:35303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:51.492630 31544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:51.494199 31544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:51.506239 31550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:51.506199 31549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:51.506207 31552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:51.506796 31544 server_base.cc:1034] running on GCE node
I20260806 11:46:51.507633 31544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:51.509037 31544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:51.510315 31544 hybrid_clock.cc:648] HybridClock initialized: now 1786016811510295 us; error 45 us; skew 500 ppm
Aug 06 11:46:51 dist-test-slave-7z32 krb5kdc[31525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:51.514232 31544 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:46:51.515872 31544 webserver.cc:460] Webserver started at http://127.26.172.254:40499/ using document root <none> and password file <none>
I20260806 11:46:51.516707 31544 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:51.516790 31544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:51.517114 31544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:51.520475 31544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "ba48b5faf3074e629feb050743547493"
format_stamp: "Formatted at 2026-08-06 11:46:51 on dist-test-slave-7z32"
server_key: "1ecbe5ec7395604ebd9ce477e512c20c"
server_key_iv: "5815ee44f94e75342518cbbb810ea2e4"
server_key_version: "encryptionkey@0"
I20260806 11:46:51.521517 31544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "ba48b5faf3074e629feb050743547493"
format_stamp: "Formatted at 2026-08-06 11:46:51 on dist-test-slave-7z32"
server_key: "1ecbe5ec7395604ebd9ce477e512c20c"
server_key_iv: "5815ee44f94e75342518cbbb810ea2e4"
server_key_version: "encryptionkey@0"
I20260806 11:46:51.528376 31544 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 11:46:51.532658 31561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:51.535022 31544 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260806 11:46:51.535282 31544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "ba48b5faf3074e629feb050743547493"
format_stamp: "Formatted at 2026-08-06 11:46:51 on dist-test-slave-7z32"
server_key: "1ecbe5ec7395604ebd9ce477e512c20c"
server_key_iv: "5815ee44f94e75342518cbbb810ea2e4"
server_key_version: "encryptionkey@0"
I20260806 11:46:51.535478 31544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:51.572669 31544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:51.577941 31544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:51.578275 31544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:51.590480 31544 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:35303
I20260806 11:46:51.591068 31630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:35303 every 8 connection(s)
I20260806 11:46:51.592301 31544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:46:51.595719 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 31544
I20260806 11:46:51.595901 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:46:51.596271 27315 external_mini_cluster.cc:1428] Setting key 34e1cfc659bf4a6497b6ce5dcf38e826
I20260806 11:46:51.596899 31633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:51.606134 31633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493: Bootstrap starting.
Aug 06 11:46:51 dist-test-slave-7z32 krb5kdc[31525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:51.609586 31633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:51.610606 31633 log.cc:824] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:51.613737 31633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493: No bootstrap required, opened a new log
I20260806 11:46:51.617086 31637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:51.598565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53078 (local address 127.26.172.254:35303)
0806 11:46:51.599257 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:51.599281 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:51.599337 (+ 56us) server_negotiation.cc:407] Connection header received
0806 11:46:51.600536 (+ 1199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:51.600567 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:51.601374 (+ 807us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:51.601962 (+ 588us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:51.603351 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:51.604634 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:51.605691 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:51.606390 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:51.606618 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:51.610355 (+ 3737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:51.610363 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:51.610390 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:51.610469 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:51.613036 (+ 2567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:51.613658 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:51.613665 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:51.613673 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:51.613858 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:51.614190 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:51.614196 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:51.614198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:51.614807 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:51.615161 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:51.615519 (+ 358us) server_negotiation.cc:299] Negotiation successful
0806 11:46:51.615989 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":238,"threads_started":1}
I20260806 11:46:51.618537 31633 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba48b5faf3074e629feb050743547493" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35303 } }
I20260806 11:46:51.618949 31633 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:51.619045 31633 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba48b5faf3074e629feb050743547493, State: Initialized, Role: FOLLOWER
I20260806 11:46:51.619618 31633 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba48b5faf3074e629feb050743547493" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35303 } }
I20260806 11:46:51.619777 31633 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:46:51.619899 31633 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:46:51.620054 31633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:51.621481 31633 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba48b5faf3074e629feb050743547493" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35303 } }
I20260806 11:46:51.621949 31633 leader_election.cc:302] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba48b5faf3074e629feb050743547493; no voters:
I20260806 11:46:51.622401 31633 leader_election.cc:288] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:46:51.622640 31640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:51.623148 31640 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [term 1 LEADER]: Becoming Leader. State: Replica: ba48b5faf3074e629feb050743547493, State: Running, Role: LEADER
I20260806 11:46:51.623628 31640 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba48b5faf3074e629feb050743547493" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35303 } }
I20260806 11:46:51.624094 31633 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:46:51.625917 31642 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba48b5faf3074e629feb050743547493. Latest consensus state: current_term: 1 leader_uuid: "ba48b5faf3074e629feb050743547493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba48b5faf3074e629feb050743547493" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35303 } } }
I20260806 11:46:51.626118 31642 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:51.626634 31641 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba48b5faf3074e629feb050743547493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba48b5faf3074e629feb050743547493" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35303 } } }
I20260806 11:46:51.626753 31641 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493 [sys.catalog]: This master's current role is: LEADER
W20260806 11:46:51.631438 31657 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:46:51.631619 31657 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:46:51.631721 31653 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:46:51.632587 31653 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:46:51.640889 31653 catalog_manager.cc:1347] Generated new cluster ID: 58d83deb12b349f286fd962075684ede
I20260806 11:46:51.641003 31653 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:46:51.650543 31653 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:46:51.652078 31653 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:46:51.663928 31653 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba48b5faf3074e629feb050743547493: Generated new TSK 0
I20260806 11:46:51.664875 31653 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:46:51.715517 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:35303
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:51.862561 31667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:51.863065 31667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:51.863168 31667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:51.867786 31667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:51.867923 31667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:51.868032 31667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:46:51.873986 31667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:35303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:51.875393 31667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:51.876595 31667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:51.888329 31674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:51.888264 31675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:51.888264 31677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:51.889158 31667 server_base.cc:1034] running on GCE node
I20260806 11:46:51.889865 31667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:51.890682 31667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:51.894025 31667 hybrid_clock.cc:648] HybridClock initialized: now 1786016811893955 us; error 93 us; skew 500 ppm
Aug 06 11:46:51 dist-test-slave-7z32 krb5kdc[31525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:51.897675 31667 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:46:51.899118 31667 webserver.cc:460] Webserver started at http://127.26.172.193:33141/ using document root <none> and password file <none>
I20260806 11:46:51.899780 31667 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:51.899854 31667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:51.900067 31667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:51.902405 31667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "6eb88c98798b42158e51997899421be6"
format_stamp: "Formatted at 2026-08-06 11:46:51 on dist-test-slave-7z32"
server_key: "0df5d8b15195add9682d969473f541e2"
server_key_iv: "0775221dbf7750e18125e2b89d5031cd"
server_key_version: "encryptionkey@0"
I20260806 11:46:51.903054 31667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "6eb88c98798b42158e51997899421be6"
format_stamp: "Formatted at 2026-08-06 11:46:51 on dist-test-slave-7z32"
server_key: "0df5d8b15195add9682d969473f541e2"
server_key_iv: "0775221dbf7750e18125e2b89d5031cd"
server_key_version: "encryptionkey@0"
I20260806 11:46:51.908002 31667 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:46:51.911758 31686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:51.913677 31667 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:46:51.913851 31667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "6eb88c98798b42158e51997899421be6"
format_stamp: "Formatted at 2026-08-06 11:46:51 on dist-test-slave-7z32"
server_key: "0df5d8b15195add9682d969473f541e2"
server_key_iv: "0775221dbf7750e18125e2b89d5031cd"
server_key_version: "encryptionkey@0"
I20260806 11:46:51.914055 31667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:51.928259 31667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:51.932119 31667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:51.932346 31667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:51.933072 31667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:51.934108 31667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:51.934185 31667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:51.934257 31667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:51.934306 31667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:51.946471 31667 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:45685
I20260806 11:46:51.946501 31833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:45685 every 8 connection(s)
I20260806 11:46:51.947621 31667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:46:51.958043 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 31667
I20260806 11:46:51.958240 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:46:51.958662 27315 external_mini_cluster.cc:1428] Setting key 27dff29b7bbf87f34207bcbe59df6bc8
Aug 06 11:46:51 dist-test-slave-7z32 krb5kdc[31525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016811, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:51.968914 31637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:51.950426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:40721 (local address 127.26.172.254:35303)
0806 11:46:51.950649 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:51.950655 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:51.952187 (+ 1532us) server_negotiation.cc:407] Connection header received
0806 11:46:51.954068 (+ 1881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:51.954073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:51.954173 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:51.954307 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:51.956027 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:51.956669 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:51.958082 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:51.958510 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:51.958660 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:51.962949 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:51.962954 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:51.962958 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:51.962999 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:51.964912 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:51.966014 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:51.966018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:51.966019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:51.966135 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:51.966887 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:51.966905 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:51.966910 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:51.967327 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:51.967477 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:51.968380 (+ 903us) server_negotiation.cc:299] Negotiation successful
0806 11:46:51.968602 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 11:46:51.970351 31838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:51.951132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:35303 (local address 127.26.172.193:40721)
0806 11:46:51.951894 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:51.951972 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:51.953607 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:51.954596 (+ 989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:51.954605 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:51.955157 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:51.955768 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:51.955793 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:51.956873 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:51.956877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:51.957903 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:51.957916 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:51.958744 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:51.958751 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:51.959040 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:51.959917 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:51.959949 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:51.962503 (+ 2554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:51.965129 (+ 2626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:51.965142 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:51.965178 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:51.965816 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:51.966266 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:51.966271 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:51.966274 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:51.966543 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:51.967511 (+ 968us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:51.967519 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:51.967991 (+ 472us) client_negotiation.cc:769] Sending connection context
0806 11:46:51.968238 (+ 247us) client_negotiation.cc:240] Negotiation successful
0806 11:46:51.968676 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":193,"threads_started":1}
I20260806 11:46:51.972491 31835 heartbeater.cc:347] Connected to a master server at 127.26.172.254:35303
I20260806 11:46:51.972996 31835 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:51.973912 31835 heartbeater.cc:511] Master 127.26.172.254:35303 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:46:51.977726 31575 ts_manager.cc:194] Registered new tserver with Master: 6eb88c98798b42158e51997899421be6 (127.26.172.193:45685)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:46:51.979920 31575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:40721
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:46:52.003897 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:35303
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:52.139046 31841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:52.139422 31841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:52.139473 31841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:52.144383 31841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:52.144531 31841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:52.144601 31841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:46:52.150507 31841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:35303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:52.151903 31841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:52.153110 31841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:52.164152 31846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:52.164286 31849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:52.164423 31847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:52.165009 31841 server_base.cc:1034] running on GCE node
I20260806 11:46:52.165787 31841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:52.166795 31841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:52.168093 31841 hybrid_clock.cc:648] HybridClock initialized: now 1786016812168056 us; error 51 us; skew 500 ppm
Aug 06 11:46:52 dist-test-slave-7z32 krb5kdc[31525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:52.172222 31841 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:46:52.173729 31841 webserver.cc:460] Webserver started at http://127.26.172.194:36745/ using document root <none> and password file <none>
I20260806 11:46:52.174606 31841 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:52.174726 31841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:52.175091 31841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:52.178074 31841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "85cb88b410b54194aa0da52aedc7a96e"
format_stamp: "Formatted at 2026-08-06 11:46:52 on dist-test-slave-7z32"
server_key: "e243d82c97a57042d671ecf7f8e99470"
server_key_iv: "1a4d67161c5e65d8ea5d6a891b959b93"
server_key_version: "encryptionkey@0"
I20260806 11:46:52.179064 31841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "85cb88b410b54194aa0da52aedc7a96e"
format_stamp: "Formatted at 2026-08-06 11:46:52 on dist-test-slave-7z32"
server_key: "e243d82c97a57042d671ecf7f8e99470"
server_key_iv: "1a4d67161c5e65d8ea5d6a891b959b93"
server_key_version: "encryptionkey@0"
I20260806 11:46:52.186295 31841 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260806 11:46:52.191066 31858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:52.193503 31841 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:46:52.193835 31841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "85cb88b410b54194aa0da52aedc7a96e"
format_stamp: "Formatted at 2026-08-06 11:46:52 on dist-test-slave-7z32"
server_key: "e243d82c97a57042d671ecf7f8e99470"
server_key_iv: "1a4d67161c5e65d8ea5d6a891b959b93"
server_key_version: "encryptionkey@0"
I20260806 11:46:52.194054 31841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:52.219916 31841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:52.224577 31841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:52.224931 31841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:52.225870 31841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:52.227140 31841 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:52.227200 31841 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:52.227250 31841 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:52.227267 31841 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:52.240785 31841 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:44893
I20260806 11:46:52.240949 32002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:44893 every 8 connection(s)
I20260806 11:46:52.242282 31841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:46:52.245883 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 31841
I20260806 11:46:52.246035 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:46:52.246423 27315 external_mini_cluster.cc:1428] Setting key c869f206bd8f5a68fc5bc6ddd2c3be5a
Aug 06 11:46:52 dist-test-slave-7z32 krb5kdc[31525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:46:52.263320 31637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:52.245147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:52815 (local address 127.26.172.254:35303)
0806 11:46:52.245321 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:52.245325 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:52.246873 (+ 1548us) server_negotiation.cc:407] Connection header received
0806 11:46:52.248818 (+ 1945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:52.248823 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:52.248900 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:52.249023 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:52.250531 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:52.251346 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:52.252945 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:52.253228 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:52.253341 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:52.257651 (+ 4310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:52.257656 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:52.257658 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:52.257703 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:52.259924 (+ 2221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:52.260881 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:52.260885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:52.260889 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:52.261012 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:52.261467 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:52.261472 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:52.261474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:52.261751 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:52.261877 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:52.262644 (+ 767us) server_negotiation.cc:299] Negotiation successful
0806 11:46:52.262929 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:46:52.264966 32008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:52.245683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:35303 (local address 127.26.172.194:52815)
0806 11:46:52.246521 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:52.246613 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:52.248531 (+ 1918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:52.249259 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:52.249268 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:52.249731 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:52.250341 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:52.250357 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:52.251550 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:52.251555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:52.252739 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:52.252758 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:52.253505 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:52.253510 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:52.253780 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:52.254807 (+ 1027us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:52.254865 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:52.257317 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:52.260177 (+ 2860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:52.260189 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:52.260262 (+ 73us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:52.260732 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:52.261126 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:52.261130 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:52.261132 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:52.261351 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:52.261891 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:52.261904 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:52.262307 (+ 403us) client_negotiation.cc:769] Sending connection context
0806 11:46:52.262595 (+ 288us) client_negotiation.cc:240] Negotiation successful
0806 11:46:52.263133 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":231,"threads_started":1}
I20260806 11:46:52.266978 32004 heartbeater.cc:347] Connected to a master server at 127.26.172.254:35303
I20260806 11:46:52.267448 32004 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:52.268374 32004 heartbeater.cc:511] Master 127.26.172.254:35303 requested a full tablet report, sending...
I20260806 11:46:52.270385 31575 ts_manager.cc:194] Registered new tserver with Master: 85cb88b410b54194aa0da52aedc7a96e (127.26.172.194:44893)
I20260806 11:46:52.271238 31575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:52815
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:46:52.293282 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:35303
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:36795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:52.435559 32011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:52.435894 32011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:52.435943 32011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:52.440307 32011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:52.440433 32011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:52.440505 32011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:46:52.446309 32011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:36795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:35303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:52.447719 32011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:52.449093 32011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:52.462422 32017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:52.462339 32019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:52.462499 32021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:52.463124 32011 server_base.cc:1034] running on GCE node
I20260806 11:46:52.463660 32011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:52.464586 32011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:52.466019 32011 hybrid_clock.cc:648] HybridClock initialized: now 1786016812465980 us; error 57 us; skew 500 ppm
Aug 06 11:46:52 dist-test-slave-7z32 krb5kdc[31525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:52.478400 32011 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:46:52.479979 32011 webserver.cc:460] Webserver started at http://127.26.172.195:39831/ using document root <none> and password file <none>
I20260806 11:46:52.481009 32011 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:52.481117 32011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:52.481432 32011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:52.484059 32011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "08da724c3771445ba01b6076f496ea6c"
format_stamp: "Formatted at 2026-08-06 11:46:52 on dist-test-slave-7z32"
server_key: "4af41016858fee18d6060c013cd3e1eb"
server_key_iv: "27a0c825bc14e7289df24e08f36541bb"
server_key_version: "encryptionkey@0"
I20260806 11:46:52.484730 32011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "08da724c3771445ba01b6076f496ea6c"
format_stamp: "Formatted at 2026-08-06 11:46:52 on dist-test-slave-7z32"
server_key: "4af41016858fee18d6060c013cd3e1eb"
server_key_iv: "27a0c825bc14e7289df24e08f36541bb"
server_key_version: "encryptionkey@0"
I20260806 11:46:52.490070 32011 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:46:52.493819 32030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:52.496142 32011 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:46:52.496393 32011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "08da724c3771445ba01b6076f496ea6c"
format_stamp: "Formatted at 2026-08-06 11:46:52 on dist-test-slave-7z32"
server_key: "4af41016858fee18d6060c013cd3e1eb"
server_key_iv: "27a0c825bc14e7289df24e08f36541bb"
server_key_version: "encryptionkey@0"
I20260806 11:46:52.496575 32011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:52.533268 32011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:52.537576 32011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:52.537863 32011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:52.538766 32011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:52.540259 32011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:52.540390 32011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:52.540503 32011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:52.540555 32011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:52.553483 32011 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:35323
I20260806 11:46:52.553529 32176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:35323 every 8 connection(s)
I20260806 11:46:52.554649 32011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:46:52.555902 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 32011
I20260806 11:46:52.556041 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:46:52.556344 27315 external_mini_cluster.cc:1428] Setting key 60de3a3cafa5c432fc2c262b16f9cbc1
Aug 06 11:46:52 dist-test-slave-7z32 krb5kdc[31525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016812, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:52.573035 31637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:52.557819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:43617 (local address 127.26.172.254:35303)
0806 11:46:52.558025 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:52.558030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:52.559366 (+ 1336us) server_negotiation.cc:407] Connection header received
0806 11:46:52.560847 (+ 1481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:52.560850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:52.560917 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:52.561012 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:52.562458 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:52.563200 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:52.564498 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:52.564819 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:52.564924 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:52.568456 (+ 3532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:52.568461 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:52.568465 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:52.568528 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:52.570467 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:52.571207 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:52.571210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:52.571212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:52.571313 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:52.571707 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:52.571710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:52.571712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:52.571958 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:52.572073 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:52.572663 (+ 590us) server_negotiation.cc:299] Negotiation successful
0806 11:46:52.572816 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 11:46:52.574039 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:52.558504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:35303 (local address 127.26.172.195:43617)
0806 11:46:52.559164 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:52.559223 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:52.560606 (+ 1383us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:52.561229 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:52.561240 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:52.561697 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:52.562254 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:52.562268 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:52.563357 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:52.563360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:52.564343 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:52.564354 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:52.565014 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:52.565017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:52.565187 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:52.566000 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:52.566020 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:52.568037 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:52.570628 (+ 2591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:52.570635 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:52.570655 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:52.571085 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:52.571429 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:52.571433 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:52.571435 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:52.571594 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:52.572088 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:52.572097 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:52.572390 (+ 293us) client_negotiation.cc:769] Sending connection context
0806 11:46:52.572609 (+ 219us) client_negotiation.cc:240] Negotiation successful
0806 11:46:52.572977 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":245,"threads_started":1}
I20260806 11:46:52.575816 32178 heartbeater.cc:347] Connected to a master server at 127.26.172.254:35303
I20260806 11:46:52.576289 32178 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:52.577181 32178 heartbeater.cc:511] Master 127.26.172.254:35303 requested a full tablet report, sending...
I20260806 11:46:52.579123 31575 ts_manager.cc:194] Registered new tserver with Master: 08da724c3771445ba01b6076f496ea6c (127.26.172.195:35323)
I20260806 11:46:52.579957 31575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:43617
I20260806 11:46:52.585582 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 11:46:52 dist-test-slave-7z32 krb5kdc[31525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016812, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 11:46:52 dist-test-slave-7z32 krb5kdc[31525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016812, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:52.624070 31637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:52.612554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53094 (local address 127.26.172.254:35303)
0806 11:46:52.612803 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:52.612808 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:52.612964 (+ 156us) server_negotiation.cc:407] Connection header received
0806 11:46:52.613201 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:52.613205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:52.613270 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:52.613379 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:52.614321 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:52.615006 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:52.615928 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:52.616175 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:52.616299 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:52.619794 (+ 3495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:52.619798 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:52.619801 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:52.619840 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:52.621576 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:52.622388 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:52.622393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:52.622395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:52.622499 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:52.622893 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:52.622897 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:52.622899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:52.623233 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:52.623407 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:52.623679 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 11:46:52.623852 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260806 11:46:52.624680 31575 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:53094
I20260806 11:46:52.626199 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 31667
I20260806 11:46:52.643893 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 31841
I20260806 11:46:52.658798 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 32011
I20260806 11:46:52.678728 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 31544
2026-08-06T11:46:52Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2886 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:46:52 dist-test-slave-7z32 krb5kdc[32193](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:46:52 dist-test-slave-7z32 krb5kdc[32193](info): set up 2 sockets
Aug 06 11:46:52 dist-test-slave-7z32 krb5kdc[32193](info): commencing operation
krb5kdc: starting...
W20260806 11:46:54.025220 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.001s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:46:54 dist-test-slave-7z32 krb5kdc[32193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:46:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:46:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:46:54.205369 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46051
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:46051
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:54.338224 32214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:54.338593 32214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:54.338636 32214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:54.343047 32214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:46:54.343140 32214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:54.343161 32214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:54.343178 32214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:46:54.343194 32214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:46:54.349556 32214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:46051
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:54.350932 32214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:54.352136 32214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:54.362808 32223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:54.362651 32219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:54.362651 32221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:54.363122 32214 server_base.cc:1034] running on GCE node
I20260806 11:46:54.363963 32214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:54.365402 32214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:54.366743 32214 hybrid_clock.cc:648] HybridClock initialized: now 1786016814366699 us; error 79 us; skew 500 ppm
Aug 06 11:46:54 dist-test-slave-7z32 krb5kdc[32193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016814, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:54.370244 32214 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:46:54.371481 32214 webserver.cc:460] Webserver started at http://127.26.172.254:46593/ using document root <none> and password file <none>
I20260806 11:46:54.372150 32214 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:54.372232 32214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:54.372443 32214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:54.374799 32214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "55cc25f26e87423e968348f2c74efb58"
format_stamp: "Formatted at 2026-08-06 11:46:54 on dist-test-slave-7z32"
server_key: "ce7f9564989667fdda537d31df9c8b9d"
server_key_iv: "4f0ee583e770f2f3816bc387e499b975"
server_key_version: "encryptionkey@0"
I20260806 11:46:54.375607 32214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "55cc25f26e87423e968348f2c74efb58"
format_stamp: "Formatted at 2026-08-06 11:46:54 on dist-test-slave-7z32"
server_key: "ce7f9564989667fdda537d31df9c8b9d"
server_key_iv: "4f0ee583e770f2f3816bc387e499b975"
server_key_version: "encryptionkey@0"
I20260806 11:46:54.380430 32214 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:46:54.383927 32236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:54.386004 32214 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:46:54.386225 32214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "55cc25f26e87423e968348f2c74efb58"
format_stamp: "Formatted at 2026-08-06 11:46:54 on dist-test-slave-7z32"
server_key: "ce7f9564989667fdda537d31df9c8b9d"
server_key_iv: "4f0ee583e770f2f3816bc387e499b975"
server_key_version: "encryptionkey@0"
I20260806 11:46:54.386369 32214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:54.420043 32214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:54.424353 32214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:54.424642 32214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:54.434393 32214 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:46051
I20260806 11:46:54.434530 32296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:46051 every 8 connection(s)
I20260806 11:46:54.435748 32214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:46:54.436854 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 32214
I20260806 11:46:54.437058 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:46:54.437362 27315 external_mini_cluster.cc:1428] Setting key e455bf4eb2bc4dd7f079571bf5b6a1b7
I20260806 11:46:54.440446 32297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 11:46:54 dist-test-slave-7z32 krb5kdc[32193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:54.448705 32297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58: Bootstrap starting.
I20260806 11:46:54.452090 32297 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:54.453145 32297 log.cc:824] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:54.454720 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:54.439293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40922 (local address 127.26.172.254:46051)
0806 11:46:54.439969 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:54.439999 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:54.440047 (+ 48us) server_negotiation.cc:407] Connection header received
0806 11:46:54.440890 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:54.440913 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:54.441341 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:54.441764 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:54.442706 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:54.443890 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:54.444820 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:54.445356 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:54.445566 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:54.448740 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:54.448746 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:54.448765 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:54.448811 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:54.451035 (+ 2224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:54.451584 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:54.451591 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:54.451597 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:54.451731 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:54.452060 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:54.452064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:54.452066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:54.452695 (+ 629us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:54.452932 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:54.453294 (+ 362us) server_negotiation.cc:299] Negotiation successful
0806 11:46:54.453654 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":233,"threads_started":1}
I20260806 11:46:54.456584 32297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58: No bootstrap required, opened a new log
I20260806 11:46:54.461506 32297 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cc25f26e87423e968348f2c74efb58" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46051 } }
I20260806 11:46:54.461913 32297 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:54.462003 32297 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55cc25f26e87423e968348f2c74efb58, State: Initialized, Role: FOLLOWER
I20260806 11:46:54.462591 32297 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cc25f26e87423e968348f2c74efb58" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46051 } }
I20260806 11:46:54.462777 32297 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:46:54.462920 32297 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:46:54.463085 32297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:54.465046 32297 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cc25f26e87423e968348f2c74efb58" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46051 } }
I20260806 11:46:54.465595 32297 leader_election.cc:302] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55cc25f26e87423e968348f2c74efb58; no voters:
I20260806 11:46:54.466075 32297 leader_election.cc:288] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:46:54.466405 32302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:54.466953 32302 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [term 1 LEADER]: Becoming Leader. State: Replica: 55cc25f26e87423e968348f2c74efb58, State: Running, Role: LEADER
I20260806 11:46:54.467389 32302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cc25f26e87423e968348f2c74efb58" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46051 } }
I20260806 11:46:54.467931 32297 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:46:54.469550 32303 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55cc25f26e87423e968348f2c74efb58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cc25f26e87423e968348f2c74efb58" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46051 } } }
I20260806 11:46:54.469712 32303 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:54.469967 32306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55cc25f26e87423e968348f2c74efb58. Latest consensus state: current_term: 1 leader_uuid: "55cc25f26e87423e968348f2c74efb58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55cc25f26e87423e968348f2c74efb58" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46051 } } }
I20260806 11:46:54.470129 32306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:54.471771 32319 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:46:54.474817 32319 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:46:54.481819 32319 catalog_manager.cc:1347] Generated new cluster ID: ac21bfab11cc435b9a7672a910555a8c
I20260806 11:46:54.481931 32319 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:46:54.515451 32319 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:46:54.517019 32319 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:46:54.524782 32319 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55cc25f26e87423e968348f2c74efb58: Generated new TSK 0
I20260806 11:46:54.525843 32319 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:46:54.574558 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46051
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:54.736111 32333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:54.736516 32333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:54.736581 32333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:54.741250 32333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:54.741396 32333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:54.741510 32333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:46:54.748409 32333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:54.750442 32333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:54.752182 32333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 11:46:54.767802 32333 server_base.cc:1034] running on GCE node
W20260806 11:46:54.767643 32340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:54.767643 32343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:54.767658 32339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:54.768689 32333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:54.769713 32333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:54.773114 32333 hybrid_clock.cc:648] HybridClock initialized: now 1786016814773057 us; error 80 us; skew 500 ppm
Aug 06 11:46:54 dist-test-slave-7z32 krb5kdc[32193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016814, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:54.776968 32333 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:46:54.778219 32333 webserver.cc:460] Webserver started at http://127.26.172.193:44521/ using document root <none> and password file <none>
I20260806 11:46:54.779016 32333 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:54.779124 32333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:54.779407 32333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:54.781790 32333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "902a56b1f0b749629b9ffdd0506fb317"
format_stamp: "Formatted at 2026-08-06 11:46:54 on dist-test-slave-7z32"
server_key: "61d80c97afa6e64becfdc97fb62e5a70"
server_key_iv: "97ac26e5667be207b41c5fb3e97acb97"
server_key_version: "encryptionkey@0"
I20260806 11:46:54.782437 32333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "902a56b1f0b749629b9ffdd0506fb317"
format_stamp: "Formatted at 2026-08-06 11:46:54 on dist-test-slave-7z32"
server_key: "61d80c97afa6e64becfdc97fb62e5a70"
server_key_iv: "97ac26e5667be207b41c5fb3e97acb97"
server_key_version: "encryptionkey@0"
I20260806 11:46:54.787324 32333 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 11:46:54.791301 32355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:54.793370 32333 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:46:54.793607 32333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "902a56b1f0b749629b9ffdd0506fb317"
format_stamp: "Formatted at 2026-08-06 11:46:54 on dist-test-slave-7z32"
server_key: "61d80c97afa6e64becfdc97fb62e5a70"
server_key_iv: "97ac26e5667be207b41c5fb3e97acb97"
server_key_version: "encryptionkey@0"
I20260806 11:46:54.793792 32333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:54.810673 32333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:54.816131 32333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:54.816431 32333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:54.817346 32333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:54.818635 32333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:54.818728 32333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:54.818811 32333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:54.818907 32333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260806 11:46:54.833362 32333 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:40167
I20260806 11:46:54.833501 32500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:40167 every 8 connection(s)
I20260806 11:46:54.834755 32333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:46:54.836755 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 32333
I20260806 11:46:54.836922 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:46:54.837344 27315 external_mini_cluster.cc:1428] Setting key 4bf226bd858ccc61c6d7e3559c04705a
Aug 06 11:46:54 dist-test-slave-7z32 krb5kdc[32193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016814, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:46:54.858469 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:54.837702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:34087 (local address 127.26.172.254:46051)
0806 11:46:54.837880 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:54.837885 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:54.839539 (+ 1654us) server_negotiation.cc:407] Connection header received
0806 11:46:54.841525 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:54.841533 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:54.841628 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:54.841781 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:54.843907 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:54.844609 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:54.846794 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:54.847233 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:54.847454 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:54.852319 (+ 4865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:54.852328 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:54.852335 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:54.852403 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:54.854682 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:54.855606 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:54.855610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:54.855612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:54.855718 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:54.856209 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:54.856213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:54.856214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:54.856529 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:54.856661 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:54.857846 (+ 1185us) server_negotiation.cc:299] Negotiation successful
0806 11:46:54.858140 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 11:46:54.859393 32506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:54.838343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46051 (local address 127.26.172.193:34087)
0806 11:46:54.839276 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:54.839345 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:54.841044 (+ 1699us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:54.842103 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:54.842112 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:54.842619 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:54.843575 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:54.843605 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:54.844832 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:54.844844 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:54.846515 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:54.846537 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:54.847552 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:54.847559 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:54.847857 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:54.848888 (+ 1031us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:54.848921 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:54.851897 (+ 2976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:54.854953 (+ 3056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:54.854968 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:54.854995 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:54.855425 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:54.855845 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:54.855849 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:54.855852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:54.856075 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:54.856778 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:54.856789 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:54.857245 (+ 456us) client_negotiation.cc:769] Sending connection context
0806 11:46:54.857504 (+ 259us) client_negotiation.cc:240] Negotiation successful
0806 11:46:54.857889 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":256,"threads_started":1}
I20260806 11:46:54.861251 32504 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46051
I20260806 11:46:54.861861 32504 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:54.862802 32504 heartbeater.cc:511] Master 127.26.172.254:46051 requested a full tablet report, sending...
I20260806 11:46:54.865432 32248 ts_manager.cc:194] Registered new tserver with Master: 902a56b1f0b749629b9ffdd0506fb317 (127.26.172.193:40167)
I20260806 11:46:54.867209 32248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:34087
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:46:54.883212 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46051
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:55.018987 32509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:55.019351 32509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:55.019403 32509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:55.024298 32509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:55.024406 32509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:55.024566 32509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:46:55.030652 32509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:55.032012 32509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:55.033200 32509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:55.045202 32522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:55.045135 32518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:55.045845 32520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:55.045956 32509 server_base.cc:1034] running on GCE node
I20260806 11:46:55.046561 32509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:55.047694 32509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:55.048945 32509 hybrid_clock.cc:648] HybridClock initialized: now 1786016815048911 us; error 49 us; skew 500 ppm
Aug 06 11:46:55 dist-test-slave-7z32 krb5kdc[32193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016815, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:55.053427 32509 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:46:55.055364 32509 webserver.cc:460] Webserver started at http://127.26.172.194:38813/ using document root <none> and password file <none>
I20260806 11:46:55.056232 32509 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:55.056325 32509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:55.056591 32509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:55.060252 32509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "b14799df3b994ac990cadeb36bd9effe"
format_stamp: "Formatted at 2026-08-06 11:46:55 on dist-test-slave-7z32"
server_key: "9f4606568ed1663f286359fa4c8dcc48"
server_key_iv: "dd8e78ff7e0d241a4ff7daef1e54050d"
server_key_version: "encryptionkey@0"
I20260806 11:46:55.061220 32509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "b14799df3b994ac990cadeb36bd9effe"
format_stamp: "Formatted at 2026-08-06 11:46:55 on dist-test-slave-7z32"
server_key: "9f4606568ed1663f286359fa4c8dcc48"
server_key_iv: "dd8e78ff7e0d241a4ff7daef1e54050d"
server_key_version: "encryptionkey@0"
I20260806 11:46:55.068002 32509 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 11:46:55.072387 32534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:55.074517 32509 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260806 11:46:55.074781 32509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "b14799df3b994ac990cadeb36bd9effe"
format_stamp: "Formatted at 2026-08-06 11:46:55 on dist-test-slave-7z32"
server_key: "9f4606568ed1663f286359fa4c8dcc48"
server_key_iv: "dd8e78ff7e0d241a4ff7daef1e54050d"
server_key_version: "encryptionkey@0"
I20260806 11:46:55.075151 32509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:55.108040 32509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:55.112718 32509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:55.113018 32509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:55.114027 32509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:55.115293 32509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:55.115368 32509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:55.115449 32509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:55.115504 32509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:55.128336 32509 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:41881
I20260806 11:46:55.128422 32681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:41881 every 8 connection(s)
I20260806 11:46:55.129725 32509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:46:55.135802 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 32509
I20260806 11:46:55.135984 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:46:55.136328 27315 external_mini_cluster.cc:1428] Setting key b56c2c7ca4fb4c15024973d066a7e662
Aug 06 11:46:55 dist-test-slave-7z32 krb5kdc[32193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016815, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:55.147800 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:55.132633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:39161 (local address 127.26.172.254:46051)
0806 11:46:55.132859 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:55.132864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:55.134141 (+ 1277us) server_negotiation.cc:407] Connection header received
0806 11:46:55.136030 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:55.136034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:55.136103 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:55.136214 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:55.137786 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.138459 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.139787 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.140022 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.140144 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:55.143593 (+ 3449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:55.143597 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:55.143599 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:55.143626 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:55.145331 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:55.145995 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:55.146002 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:55.146008 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:55.146100 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:55.146490 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:55.146494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:55.146495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:55.146707 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:55.146823 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:55.147452 (+ 629us) server_negotiation.cc:299] Negotiation successful
0806 11:46:55.147601 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 11:46:55.148754 32685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:55.133153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46051 (local address 127.26.172.194:39161)
0806 11:46:55.133907 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:55.133980 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:55.135750 (+ 1770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:55.136461 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:55.136471 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:55.137020 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:55.137615 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:55.137630 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.138617 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.138623 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:55.139645 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:55.139657 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.140201 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.140205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:55.140395 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:55.141183 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:55.141201 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:55.143314 (+ 2113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:55.145506 (+ 2192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:55.145514 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:55.145533 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:55.145852 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:55.146211 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:55.146214 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:55.146216 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:55.146376 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:55.146849 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:55.146860 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:55.147160 (+ 300us) client_negotiation.cc:769] Sending connection context
0806 11:46:55.147380 (+ 220us) client_negotiation.cc:240] Negotiation successful
0806 11:46:55.147772 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":155,"threads_started":1}
I20260806 11:46:55.150130 32683 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46051
I20260806 11:46:55.150437 32683 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:46:55.151129 32683 heartbeater.cc:511] Master 127.26.172.254:46051 requested a full tablet report, sending...
I20260806 11:46:55.152335 32248 ts_manager.cc:194] Registered new tserver with Master: b14799df3b994ac990cadeb36bd9effe (127.26.172.194:41881)
I20260806 11:46:55.152993 32248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:39161
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:46:55.180380 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46051
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:38711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:55.348917 32690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:55.349395 32690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:55.349457 32690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:55.355654 32690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:55.355786 32690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:55.355862 32690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:46:55.363888 32690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:55.365535 32690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:55.367045 32690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:55.381590 32697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:55.381609 32700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:55.381652 32690 server_base.cc:1034] running on GCE node
W20260806 11:46:55.381590 32696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:55.382470 32690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:55.383409 32690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:55.384696 32690 hybrid_clock.cc:648] HybridClock initialized: now 1786016815384659 us; error 57 us; skew 500 ppm
Aug 06 11:46:55 dist-test-slave-7z32 krb5kdc[32193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016815, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:55.388501 32690 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:46:55.389786 32690 webserver.cc:460] Webserver started at http://127.26.172.195:39013/ using document root <none> and password file <none>
I20260806 11:46:55.390654 32690 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:55.390769 32690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:55.391086 32690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:55.393747 32690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "c8894f11ac7149cfa24b6bad4cfee463"
format_stamp: "Formatted at 2026-08-06 11:46:55 on dist-test-slave-7z32"
server_key: "d46f28ccf9eef2c01e206270d7cd1bc1"
server_key_iv: "bae03d7b3868fe06d610ef972e49f461"
server_key_version: "encryptionkey@0"
I20260806 11:46:55.394460 32690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "c8894f11ac7149cfa24b6bad4cfee463"
format_stamp: "Formatted at 2026-08-06 11:46:55 on dist-test-slave-7z32"
server_key: "d46f28ccf9eef2c01e206270d7cd1bc1"
server_key_iv: "bae03d7b3868fe06d610ef972e49f461"
server_key_version: "encryptionkey@0"
I20260806 11:46:55.399727 32690 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 11:46:55.403504 32710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:55.405498 32690 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:46:55.405722 32690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "c8894f11ac7149cfa24b6bad4cfee463"
format_stamp: "Formatted at 2026-08-06 11:46:55 on dist-test-slave-7z32"
server_key: "d46f28ccf9eef2c01e206270d7cd1bc1"
server_key_iv: "bae03d7b3868fe06d610ef972e49f461"
server_key_version: "encryptionkey@0"
I20260806 11:46:55.405891 32690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:55.441931 32690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:55.447484 32690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:55.447851 32690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:55.448869 32690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:55.450382 32690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:55.450464 32690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:55.450534 32690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:55.450582 32690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:55.467410 32690 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:45309
I20260806 11:46:55.467461 384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:45309 every 8 connection(s)
I20260806 11:46:55.468714 32690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:46:55.476886 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 32690
I20260806 11:46:55.477118 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:46:55.477531 27315 external_mini_cluster.cc:1428] Setting key fe4502e6d3c4d8ea340a485afde731eb
Aug 06 11:46:55 dist-test-slave-7z32 krb5kdc[32193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016815, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:55.488768 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:55.471617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:41815 (local address 127.26.172.254:46051)
0806 11:46:55.471826 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:55.471833 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:55.473081 (+ 1248us) server_negotiation.cc:407] Connection header received
0806 11:46:55.474866 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:55.474870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:55.474945 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:55.475070 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:55.476553 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.477387 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.479122 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.479650 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.479841 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:55.483735 (+ 3894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:55.483740 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:55.483742 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:55.483789 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:55.485621 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:55.486407 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:55.486411 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:55.486412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:55.486586 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:55.487248 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:55.487252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:55.487253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:55.487519 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:55.487667 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:55.488385 (+ 718us) server_negotiation.cc:299] Negotiation successful
0806 11:46:55.488544 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 11:46:55.489833 387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:55.472168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46051 (local address 127.26.172.195:41815)
0806 11:46:55.472858 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:55.472932 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:55.474549 (+ 1617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:55.475303 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:55.475312 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:55.475771 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:55.476343 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:55.476358 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.477544 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.477548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:55.478940 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:55.478951 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.480013 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.480020 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:55.480273 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:55.481325 (+ 1052us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:55.481345 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:55.483355 (+ 2010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:55.485815 (+ 2460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:55.485821 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:55.485839 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:55.486230 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:55.486742 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:55.486746 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:55.486747 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:55.487090 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:55.487660 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:55.487667 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:55.488054 (+ 387us) client_negotiation.cc:769] Sending connection context
0806 11:46:55.488265 (+ 211us) client_negotiation.cc:240] Negotiation successful
0806 11:46:55.488651 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":175,"threads_started":1}
I20260806 11:46:55.492022 385 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46051
I20260806 11:46:55.492375 385 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:55.493151 385 heartbeater.cc:511] Master 127.26.172.254:46051 requested a full tablet report, sending...
I20260806 11:46:55.494620 32248 ts_manager.cc:194] Registered new tserver with Master: c8894f11ac7149cfa24b6bad4cfee463 (127.26.172.195:45309)
I20260806 11:46:55.495355 32248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:41815
I20260806 11:46:55.505983 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 11:46:55 dist-test-slave-7z32 krb5kdc[32193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 11:46:55 dist-test-slave-7z32 krb5kdc[32193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:46:55.544792 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:55.531168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38098 (local address 127.26.172.193:40167)
0806 11:46:55.531625 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:55.531632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:55.531665 (+ 33us) server_negotiation.cc:407] Connection header received
0806 11:46:55.531730 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:55.531736 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:55.532022 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:55.532188 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:55.533193 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.534366 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.535610 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.536173 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.536307 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:55.539690 (+ 3383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:55.539708 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:55.539728 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:55.539777 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:55.542064 (+ 2287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:55.542940 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:55.542949 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:55.542951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:55.543072 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:55.543502 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:55.543505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:55.543506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:55.543821 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:55.544044 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:55.544456 (+ 412us) server_negotiation.cc:299] Negotiation successful
0806 11:46:55.544634 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":148,"threads_started":1}
Aug 06 11:46:55 dist-test-slave-7z32 krb5kdc[32193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:55.562580 32300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:55.550292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40932 (local address 127.26.172.254:46051)
0806 11:46:55.550530 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:55.550535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:55.550678 (+ 143us) server_negotiation.cc:407] Connection header received
0806 11:46:55.550775 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:55.550779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:55.550947 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:55.551050 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:55.551901 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.552531 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.553553 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:55.553784 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:55.553884 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:55.557310 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:55.557314 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:55.557318 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:55.557359 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:55.559526 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:55.560335 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:55.560343 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:55.560345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:55.560486 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:55.561224 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:55.561228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:55.561229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:55.561568 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:55.561713 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:55.562080 (+ 367us) server_negotiation.cc:299] Negotiation successful
0806 11:46:55.562311 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
W20260806 11:46:55.563481 32248 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40932
I20260806 11:46:55.564888 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 32333
I20260806 11:46:55.582427 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 32509
I20260806 11:46:55.601033 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 32690
I20260806 11:46:55.617465 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 32214
2026-08-06T11:46:55Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2939 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:46:55 dist-test-slave-7z32 krb5kdc[399](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:46:55 dist-test-slave-7z32 krb5kdc[399](info): set up 2 sockets
Aug 06 11:46:55 dist-test-slave-7z32 krb5kdc[399](info): commencing operation
krb5kdc: starting...
W20260806 11:46:56.929589 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.004s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:46:57 dist-test-slave-7z32 krb5kdc[399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:46:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:46:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:46:57.103803 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:41337
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:45533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:41337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:57.250069 417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:57.250437 417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:57.250492 417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:57.255033 417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:46:57.255143 417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:57.255165 417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:57.255183 417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:46:57.255199 417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:46:57.261564 417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:45533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:41337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:41337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:57.263319 417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:57.264746 417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:57.278276 432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:57.278291 429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:57.278507 428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:57.278959 417 server_base.cc:1034] running on GCE node
I20260806 11:46:57.279853 417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:57.281380 417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:57.282814 417 hybrid_clock.cc:648] HybridClock initialized: now 1786016817282783 us; error 75 us; skew 500 ppm
Aug 06 11:46:57 dist-test-slave-7z32 krb5kdc[399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016817, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:57.286803 417 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:46:57.287982 417 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:57.288116 417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:57.288446 417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:57.291255 417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "3bb68695c3b84c3aab859b054ab448a0"
format_stamp: "Formatted at 2026-08-06 11:46:57 on dist-test-slave-7z32"
server_key: "2c3ca2f4874a0ede8b96336c84a44f64"
server_key_iv: "29a28f07b6c67039e59aafa407a33f63"
server_key_version: "encryptionkey@0"
I20260806 11:46:57.292038 417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "3bb68695c3b84c3aab859b054ab448a0"
format_stamp: "Formatted at 2026-08-06 11:46:57 on dist-test-slave-7z32"
server_key: "2c3ca2f4874a0ede8b96336c84a44f64"
server_key_iv: "29a28f07b6c67039e59aafa407a33f63"
server_key_version: "encryptionkey@0"
I20260806 11:46:57.297253 417 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:46:57.300865 438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:57.302732 417 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 11:46:57.303007 417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "3bb68695c3b84c3aab859b054ab448a0"
format_stamp: "Formatted at 2026-08-06 11:46:57 on dist-test-slave-7z32"
server_key: "2c3ca2f4874a0ede8b96336c84a44f64"
server_key_iv: "29a28f07b6c67039e59aafa407a33f63"
server_key_version: "encryptionkey@0"
I20260806 11:46:57.303186 417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:57.317555 417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:57.321630 417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:57.321898 417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:57.331344 417 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:41337
I20260806 11:46:57.331693 503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:41337 every 8 connection(s)
I20260806 11:46:57.332320 417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:46:57.336503 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 417
I20260806 11:46:57.336695 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:46:57.337075 27315 external_mini_cluster.cc:1428] Setting key 061688dead6024f4a1bc1946ae8e654e
I20260806 11:46:57.337316 506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:57.348625 506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0: Bootstrap starting.
Aug 06 11:46:57 dist-test-slave-7z32 krb5kdc[399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:57.352478 506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:57.353688 506 log.cc:824] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:57.357908 506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0: No bootstrap required, opened a new log
I20260806 11:46:57.358489 511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:57.339362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35304 (local address 127.26.172.254:41337)
0806 11:46:57.339992 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:57.340012 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:57.340055 (+ 43us) server_negotiation.cc:407] Connection header received
0806 11:46:57.341180 (+ 1125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:57.341205 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:57.341632 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:57.341983 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:57.343434 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:57.344743 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:57.346610 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:57.347469 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:57.347683 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:57.351575 (+ 3892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:57.351582 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:57.351605 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:57.351651 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:57.354040 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:57.354773 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:57.354782 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:57.354790 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:57.355045 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:57.355639 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:57.355642 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:57.355643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:57.356221 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:57.356468 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:57.356920 (+ 452us) server_negotiation.cc:299] Negotiation successful
0806 11:46:57.357370 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":210,"threads_started":1}
I20260806 11:46:57.363363 506 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb68695c3b84c3aab859b054ab448a0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41337 } }
I20260806 11:46:57.363765 506 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:57.363910 506 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb68695c3b84c3aab859b054ab448a0, State: Initialized, Role: FOLLOWER
I20260806 11:46:57.364532 506 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb68695c3b84c3aab859b054ab448a0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41337 } }
I20260806 11:46:57.364727 506 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:46:57.364830 506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:46:57.364970 506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:57.366354 506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb68695c3b84c3aab859b054ab448a0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41337 } }
I20260806 11:46:57.366945 506 leader_election.cc:302] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bb68695c3b84c3aab859b054ab448a0; no voters:
I20260806 11:46:57.367471 506 leader_election.cc:288] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:46:57.367570 513 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:57.367884 513 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [term 1 LEADER]: Becoming Leader. State: Replica: 3bb68695c3b84c3aab859b054ab448a0, State: Running, Role: LEADER
I20260806 11:46:57.368330 513 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb68695c3b84c3aab859b054ab448a0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41337 } }
I20260806 11:46:57.369621 506 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:46:57.370981 515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bb68695c3b84c3aab859b054ab448a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb68695c3b84c3aab859b054ab448a0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41337 } } }
I20260806 11:46:57.371328 515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:57.371888 514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bb68695c3b84c3aab859b054ab448a0. Latest consensus state: current_term: 1 leader_uuid: "3bb68695c3b84c3aab859b054ab448a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb68695c3b84c3aab859b054ab448a0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41337 } } }
I20260806 11:46:57.371966 524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:46:57.372080 514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:57.376766 524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:46:57.385499 524 catalog_manager.cc:1347] Generated new cluster ID: 26fdf278185d45c6b9adf2b6800b0ad3
I20260806 11:46:57.385757 524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:46:57.397156 524 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:46:57.399108 524 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:46:57.410799 524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0: Generated new TSK 0
I20260806 11:46:57.412145 524 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:46:57.464154 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41337
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:45533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:57.626060 540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:57.626447 540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:57.626503 540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:57.631343 540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:57.631460 540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:57.631538 540 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:46:57.638367 540 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:45533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:57.640125 540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:57.641619 540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:57.655797 546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:57.655804 545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:57.656033 540 server_base.cc:1034] running on GCE node
W20260806 11:46:57.655788 548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:57.656968 540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:57.658010 540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:57.661374 540 hybrid_clock.cc:648] HybridClock initialized: now 1786016817661291 us; error 100 us; skew 500 ppm
Aug 06 11:46:57 dist-test-slave-7z32 krb5kdc[399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016817, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:57.672750 540 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:46:57.674014 540 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:57.674146 540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:57.674480 540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:57.677690 540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "e3a75e57336a4e1392f1f5c182347b4e"
format_stamp: "Formatted at 2026-08-06 11:46:57 on dist-test-slave-7z32"
server_key: "d6184ecefb782c51aaa4315fa5f913bf"
server_key_iv: "88f80ec4b356b69dadc8f6d19b754f26"
server_key_version: "encryptionkey@0"
I20260806 11:46:57.678575 540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "e3a75e57336a4e1392f1f5c182347b4e"
format_stamp: "Formatted at 2026-08-06 11:46:57 on dist-test-slave-7z32"
server_key: "d6184ecefb782c51aaa4315fa5f913bf"
server_key_iv: "88f80ec4b356b69dadc8f6d19b754f26"
server_key_version: "encryptionkey@0"
I20260806 11:46:57.684890 540 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.001s
I20260806 11:46:57.689222 555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:57.691375 540 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:46:57.691607 540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "e3a75e57336a4e1392f1f5c182347b4e"
format_stamp: "Formatted at 2026-08-06 11:46:57 on dist-test-slave-7z32"
server_key: "d6184ecefb782c51aaa4315fa5f913bf"
server_key_iv: "88f80ec4b356b69dadc8f6d19b754f26"
server_key_version: "encryptionkey@0"
I20260806 11:46:57.691792 540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:57.718535 540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:57.723457 540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:57.723762 540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:57.724615 540 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:57.725836 540 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:57.725925 540 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:57.726015 540 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:57.726068 540 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:57.740486 540 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:36763
I20260806 11:46:57.740530 702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:36763 every 8 connection(s)
I20260806 11:46:57.741415 540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:46:57.747619 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 540
I20260806 11:46:57.747799 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:46:57.748153 27315 external_mini_cluster.cc:1428] Setting key fc3264e4d152067b808e1b758fd33995
Aug 06 11:46:57 dist-test-slave-7z32 krb5kdc[399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016817, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:46:57.763152 511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:57.744130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:35443 (local address 127.26.172.254:41337)
0806 11:46:57.744348 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:57.744354 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:57.745742 (+ 1388us) server_negotiation.cc:407] Connection header received
0806 11:46:57.747432 (+ 1690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:57.747436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:57.747586 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:57.747714 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:57.749504 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:57.750388 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:57.752384 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:57.752666 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:57.752841 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:57.757366 (+ 4525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:57.757374 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:57.757381 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:57.757432 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:57.759895 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:57.760805 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:57.760813 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:57.760816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:57.760964 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:57.761466 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:57.761471 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:57.761474 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:57.761838 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:57.761981 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:57.762707 (+ 726us) server_negotiation.cc:299] Negotiation successful
0806 11:46:57.762962 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 11:46:57.764281 705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:57.744806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41337 (local address 127.26.172.193:35443)
0806 11:46:57.745511 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:57.745573 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:57.747089 (+ 1516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:57.747995 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:57.748007 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:57.748608 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:57.749287 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:57.749308 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:57.750568 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:57.750573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:57.752194 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:57.752212 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:57.752948 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:57.752955 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:57.753219 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:57.754152 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:57.754174 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:57.757043 (+ 2869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:57.760125 (+ 3082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:57.760134 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:57.760155 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:57.760615 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:57.761113 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:57.761116 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:57.761118 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:57.761313 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:57.761980 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:57.761987 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:57.762330 (+ 343us) client_negotiation.cc:769] Sending connection context
0806 11:46:57.762592 (+ 262us) client_negotiation.cc:240] Negotiation successful
0806 11:46:57.763078 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":175,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:46:57.766618 703 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41337
I20260806 11:46:57.767063 703 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:57.767773 703 heartbeater.cc:511] Master 127.26.172.254:41337 requested a full tablet report, sending...
I20260806 11:46:57.770120 459 ts_manager.cc:194] Registered new tserver with Master: e3a75e57336a4e1392f1f5c182347b4e (127.26.172.193:36763)
I20260806 11:46:57.772287 459 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:35443
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:46:57.792425 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41337
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:45533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:57.948203 710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:57.948622 710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:57.948681 710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:57.953341 710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:57.953454 710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:57.953531 710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:46:57.960840 710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:45533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:57.962568 710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:57.964102 710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:57.978535 717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:57.978540 718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:57.978631 710 server_base.cc:1034] running on GCE node
W20260806 11:46:57.978535 720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:57.979601 710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:57.980582 710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:57.981942 710 hybrid_clock.cc:648] HybridClock initialized: now 1786016817981916 us; error 49 us; skew 500 ppm
Aug 06 11:46:57 dist-test-slave-7z32 krb5kdc[399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016817, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:57.986152 710 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:46:57.987286 710 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:57.987375 710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:57.987587 710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:57.990127 710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476"
format_stamp: "Formatted at 2026-08-06 11:46:57 on dist-test-slave-7z32"
server_key: "0ce2b5141958b9c1533e5a9f17131dbc"
server_key_iv: "72d8e58b3b190323542c3c88c29c76df"
server_key_version: "encryptionkey@0"
I20260806 11:46:57.990761 710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476"
format_stamp: "Formatted at 2026-08-06 11:46:57 on dist-test-slave-7z32"
server_key: "0ce2b5141958b9c1533e5a9f17131dbc"
server_key_iv: "72d8e58b3b190323542c3c88c29c76df"
server_key_version: "encryptionkey@0"
I20260806 11:46:57.995958 710 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:46:57.999778 726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:58.002167 710 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:46:58.002363 710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476"
format_stamp: "Formatted at 2026-08-06 11:46:57 on dist-test-slave-7z32"
server_key: "0ce2b5141958b9c1533e5a9f17131dbc"
server_key_iv: "72d8e58b3b190323542c3c88c29c76df"
server_key_version: "encryptionkey@0"
I20260806 11:46:58.002612 710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:58.024991 710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:58.029184 710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:58.029443 710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:58.030247 710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:58.031406 710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:58.031498 710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:58.031582 710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:58.031636 710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:58.043885 710 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:44055
I20260806 11:46:58.043908 873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:44055 every 8 connection(s)
I20260806 11:46:58.044690 710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:46:58.054652 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 710
I20260806 11:46:58.054872 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:46:58.055354 27315 external_mini_cluster.cc:1428] Setting key 26c89f3e337293eb791470b53d393796
Aug 06 11:46:58 dist-test-slave-7z32 krb5kdc[399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016817, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:58.064157 511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.047526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:60775 (local address 127.26.172.254:41337)
0806 11:46:58.047801 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:58.047807 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:58.048967 (+ 1160us) server_negotiation.cc:407] Connection header received
0806 11:46:58.050901 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:58.050906 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:58.050990 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:58.051121 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:58.052792 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.053453 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.055303 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.055690 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.055838 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.059774 (+ 3936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:58.059778 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:58.059781 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:58.059818 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:58.061516 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:58.062206 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:58.062210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:58.062212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:58.062311 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:58.062708 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:58.062713 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:58.062714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:58.063024 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:58.063145 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:58.063792 (+ 647us) server_negotiation.cc:299] Negotiation successful
0806 11:46:58.063949 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260806 11:46:58.065198 876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.047918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41337 (local address 127.26.172.194:60775)
0806 11:46:58.048681 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:58.048758 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:58.050539 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:58.051368 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:58.051377 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:58.051915 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:58.052587 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.052604 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.053629 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.053633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.055043 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.055061 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.055955 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.055960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.056179 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.057074 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:58.057096 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:58.059547 (+ 2451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:58.061713 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:58.061721 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:58.061748 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:58.062084 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:58.062414 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:58.062417 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:58.062420 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:58.062601 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:58.063146 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:58.063158 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:58.063486 (+ 328us) client_negotiation.cc:769] Sending connection context
0806 11:46:58.063723 (+ 237us) client_negotiation.cc:240] Negotiation successful
0806 11:46:58.064148 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":145,"threads_started":1}
I20260806 11:46:58.067030 874 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41337
I20260806 11:46:58.067494 874 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:58.068216 874 heartbeater.cc:511] Master 127.26.172.254:41337 requested a full tablet report, sending...
I20260806 11:46:58.069777 459 ts_manager.cc:194] Registered new tserver with Master: 9ebe24f33c8c4b9eabc322ca9ab8b476 (127.26.172.194:44055)
I20260806 11:46:58.070554 459 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:60775
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:46:58.116670 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41337
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:45533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:46:58.274339 880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:58.274745 880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:58.274874 880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:58.279660 880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:58.279779 880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:58.279898 880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:46:58.287355 880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:45533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:58.289080 880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:58.290591 880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:58.304258 886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:58.304250 889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:58.304638 880 server_base.cc:1034] running on GCE node
W20260806 11:46:58.304250 887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:58.305398 880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:58.306345 880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:58.307662 880 hybrid_clock.cc:648] HybridClock initialized: now 1786016818307550 us; error 125 us; skew 500 ppm
Aug 06 11:46:58 dist-test-slave-7z32 krb5kdc[399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016818, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:46:58.312251 880 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:46:58.313601 880 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:58.313741 880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:58.314090 880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:58.317220 880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "c00f1ff042474dc5a3cc03a99505230e"
format_stamp: "Formatted at 2026-08-06 11:46:58 on dist-test-slave-7z32"
server_key: "ed5a69ea10f30526669a5c6b924d9c91"
server_key_iv: "31775aa5988c08a69c62fd53289b6b8b"
server_key_version: "encryptionkey@0"
I20260806 11:46:58.318043 880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "c00f1ff042474dc5a3cc03a99505230e"
format_stamp: "Formatted at 2026-08-06 11:46:58 on dist-test-slave-7z32"
server_key: "ed5a69ea10f30526669a5c6b924d9c91"
server_key_iv: "31775aa5988c08a69c62fd53289b6b8b"
server_key_version: "encryptionkey@0"
I20260806 11:46:58.324046 880 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 11:46:58.328569 895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:58.330557 880 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260806 11:46:58.330945 880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "c00f1ff042474dc5a3cc03a99505230e"
format_stamp: "Formatted at 2026-08-06 11:46:58 on dist-test-slave-7z32"
server_key: "ed5a69ea10f30526669a5c6b924d9c91"
server_key_iv: "31775aa5988c08a69c62fd53289b6b8b"
server_key_version: "encryptionkey@0"
I20260806 11:46:58.331204 880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:58.352964 880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:58.357517 880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:58.357923 880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:58.358999 880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:58.360319 880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:58.360411 880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:58.360498 880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:58.360544 880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:58.374182 880 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:38713
I20260806 11:46:58.374224 1043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:38713 every 8 connection(s)
I20260806 11:46:58.375118 880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:46:58.378590 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 880
I20260806 11:46:58.378767 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:46:58.379148 27315 external_mini_cluster.cc:1428] Setting key c77043c03ad92f0c4cb07641b867b6bb
Aug 06 11:46:58 dist-test-slave-7z32 krb5kdc[399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016818, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:46:58.395623 511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.377830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:40245 (local address 127.26.172.254:41337)
0806 11:46:58.378061 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:58.378066 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:58.379378 (+ 1312us) server_negotiation.cc:407] Connection header received
0806 11:46:58.381071 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:58.381075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:58.381139 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:58.381250 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:58.383273 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.383949 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.385460 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.385752 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.385880 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.389715 (+ 3835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:58.389724 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:58.389727 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:58.389769 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:58.392222 (+ 2453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:58.393308 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:58.393313 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:58.393315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:58.393468 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:58.393981 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:58.393985 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:58.393986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:58.394325 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:58.394462 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:58.395205 (+ 743us) server_negotiation.cc:299] Negotiation successful
0806 11:46:58.395440 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 11:46:58.396716 1046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.378419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41337 (local address 127.26.172.195:40245)
0806 11:46:58.379138 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:58.379206 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:58.380810 (+ 1604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:58.381541 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:58.381551 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:58.382219 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:58.383042 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.383064 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.384141 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.384144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.385267 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.385281 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.386007 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.386012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.386236 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.387144 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:46:58.387167 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:58.389369 (+ 2202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:58.392486 (+ 3117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:58.392500 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:58.392530 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:58.393034 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:58.393599 (+ 565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:46:58.393603 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:46:58.393605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:46:58.393830 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:46:58.394455 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:58.394462 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:58.394910 (+ 448us) client_negotiation.cc:769] Sending connection context
0806 11:46:58.395142 (+ 232us) client_negotiation.cc:240] Negotiation successful
0806 11:46:58.395565 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":196,"threads_started":1}
I20260806 11:46:58.398470 1044 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41337
I20260806 11:46:58.398903 1044 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:58.399559 1044 heartbeater.cc:511] Master 127.26.172.254:41337 requested a full tablet report, sending...
I20260806 11:46:58.401078 459 ts_manager.cc:194] Registered new tserver with Master: c00f1ff042474dc5a3cc03a99505230e (127.26.172.195:38713)
I20260806 11:46:58.401784 459 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:40245
I20260806 11:46:58.407758 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:46:58.420225 511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.411245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35312 (local address 127.26.172.254:41337)
0806 11:46:58.411522 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:58.411527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:58.411627 (+ 100us) server_negotiation.cc:407] Connection header received
0806 11:46:58.411867 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:58.411871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:58.411928 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:58.412029 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:58.412882 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.413632 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.414627 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.415040 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.415163 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.416663 (+ 1500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:58.416667 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:58.416670 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:46:58.416699 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:58.418280 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:58.418748 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:58.418753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:58.418754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:58.418939 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:46:58.419239 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:46:58.419242 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:46:58.419244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:46:58.419503 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:58.419657 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:58.419915 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 11:46:58.420043 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260806 11:46:58.425115 459 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:46:58.429406 459 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:58.448787 1061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.442470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47334 (local address 127.26.172.193:36763)
0806 11:46:58.443091 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:58.443103 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:58.443136 (+ 33us) server_negotiation.cc:407] Connection header received
0806 11:46:58.443241 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:58.443249 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:58.443534 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:58.444206 (+ 672us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:58.444384 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.445525 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.447226 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.447886 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.448025 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.448176 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:58.448476 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 11:46:58.448592 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":213,"threads_started":1}
I20260806 11:46:58.448800 1059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.442125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:36763 (local address 127.0.0.1:47334)
0806 11:46:58.442805 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:58.442900 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:58.443065 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:58.443766 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:58.443774 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:58.443807 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:58.444002 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.444022 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.445666 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.445670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.447091 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.447101 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.448032 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.448038 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.448197 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.448263 (+ 66us) client_negotiation.cc:769] Sending connection context
0806 11:46:58.448409 (+ 146us) client_negotiation.cc:240] Negotiation successful
0806 11:46:58.448585 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":207,"threads_started":1}
I20260806 11:46:58.449781 1064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.443547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60242 (local address 127.26.172.194:44055)
0806 11:46:58.444269 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:58.444284 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:58.444314 (+ 30us) server_negotiation.cc:407] Connection header received
0806 11:46:58.444428 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:58.444434 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:58.444628 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:58.444814 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:58.445137 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.446209 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.447912 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.448755 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.448902 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.449040 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:58.449495 (+ 455us) server_negotiation.cc:299] Negotiation successful
0806 11:46:58.449602 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":152,"threads_started":1}
I20260806 11:46:58.449820 1065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.443690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:38713 (local address 127.0.0.1:53938)
0806 11:46:58.444048 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:58.444066 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:58.444156 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:58.445011 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:58.445015 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:58.445036 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:58.445155 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.445161 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.446772 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.446776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.447989 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.448001 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.449293 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.449299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.449473 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.449503 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 11:46:58.449569 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 11:46:58.449665 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":57,"thread_start_us":107,"threads_started":1}
I20260806 11:46:58.450143 1063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.443264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:44055 (local address 127.0.0.1:60242)
0806 11:46:58.443588 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:58.443606 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:58.443703 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:58.444787 (+ 1084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:58.444791 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:58.444813 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:58.444994 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.445002 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.446380 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.446384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.447737 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.447750 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.449127 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.449131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.449241 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.449274 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 11:46:58.449355 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 11:46:58.450033 (+ 678us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":543,"thread_start_us":137,"threads_started":1}
I20260806 11:46:58.450714 1066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.444096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53938 (local address 127.26.172.195:38713)
0806 11:46:58.444526 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:58.444538 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:58.444561 (+ 23us) server_negotiation.cc:407] Connection header received
0806 11:46:58.444637 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:58.444642 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:58.444841 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:58.445300 (+ 459us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:58.445476 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.446618 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.448162 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.449140 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.450114 (+ 974us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.450375 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:58.450437 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 11:46:58.450555 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":131,"threads_started":1}
I20260806 11:46:58.453869 793 tablet_service.cc:1467] Processing CreateTablet for tablet f26d605d2b254ab9b3d97f40896345bc (DEFAULT_TABLE table=test-table [id=9c9b2bfcc7fc42c681b6774053b6a83c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:58.453867 618 tablet_service.cc:1467] Processing CreateTablet for tablet f26d605d2b254ab9b3d97f40896345bc (DEFAULT_TABLE table=test-table [id=9c9b2bfcc7fc42c681b6774053b6a83c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:58.454705 963 tablet_service.cc:1467] Processing CreateTablet for tablet f26d605d2b254ab9b3d97f40896345bc (DEFAULT_TABLE table=test-table [id=9c9b2bfcc7fc42c681b6774053b6a83c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:58.455593 793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f26d605d2b254ab9b3d97f40896345bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:58.455593 618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f26d605d2b254ab9b3d97f40896345bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:58.456087 963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f26d605d2b254ab9b3d97f40896345bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:58.463749 1068 tablet_bootstrap.cc:492] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: Bootstrap starting.
I20260806 11:46:58.465938 1070 tablet_bootstrap.cc:492] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: Bootstrap starting.
I20260806 11:46:58.467355 1068 tablet_bootstrap.cc:654] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:58.468381 1070 tablet_bootstrap.cc:654] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:58.468983 1068 log.cc:824] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:58.469722 1070 log.cc:824] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:58.470132 1069 tablet_bootstrap.cc:492] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e: Bootstrap starting.
I20260806 11:46:58.472365 1068 tablet_bootstrap.cc:492] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: No bootstrap required, opened a new log
I20260806 11:46:58.472596 1068 ts_tablet_manager.cc:1397] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 11:46:58.472625 1070 tablet_bootstrap.cc:492] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: No bootstrap required, opened a new log
I20260806 11:46:58.472802 1069 tablet_bootstrap.cc:654] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:58.472903 1070 ts_tablet_manager.cc:1397] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 11:46:58.473662 1069 log.cc:824] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:58.477260 1070 raft_consensus.cc:348] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 } } peers { permanent_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 44055 } } peers { permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 } }
I20260806 11:46:58.477735 1070 raft_consensus.cc:374] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:58.477808 1070 raft_consensus.cc:729] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ebe24f33c8c4b9eabc322ca9ab8b476, State: Initialized, Role: FOLLOWER
I20260806 11:46:58.477905 1069 tablet_bootstrap.cc:492] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e: No bootstrap required, opened a new log
I20260806 11:46:58.478170 1069 ts_tablet_manager.cc:1397] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260806 11:46:58.478559 1070 consensus_queue.cc:260] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 } } peers { permanent_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 44055 } } peers { permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 } }
I20260806 11:46:58.478582 1068 raft_consensus.cc:348] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 } } peers { permanent_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 44055 } } peers { permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 } }
I20260806 11:46:58.478991 1068 raft_consensus.cc:374] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:58.479066 1068 raft_consensus.cc:729] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00f1ff042474dc5a3cc03a99505230e, State: Initialized, Role: FOLLOWER
I20260806 11:46:58.479611 1068 consensus_queue.cc:260] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 } } peers { permanent_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 44055 } } peers { permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 } }
I20260806 11:46:58.479985 1070 ts_tablet_manager.cc:1428] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 11:46:58.480612 1044 heartbeater.cc:503] Master 127.26.172.254:41337 was elected leader, sending a full tablet report...
I20260806 11:46:58.480600 874 heartbeater.cc:503] Master 127.26.172.254:41337 was elected leader, sending a full tablet report...
I20260806 11:46:58.481025 1068 ts_tablet_manager.cc:1428] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: Time spent starting tablet: real 0.008s user 0.001s sys 0.004s
I20260806 11:46:58.484397 1069 raft_consensus.cc:348] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 } } peers { permanent_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 44055 } } peers { permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 } }
I20260806 11:46:58.484773 1069 raft_consensus.cc:374] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:58.484863 1069 raft_consensus.cc:729] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3a75e57336a4e1392f1f5c182347b4e, State: Initialized, Role: FOLLOWER
I20260806 11:46:58.485430 1069 consensus_queue.cc:260] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 } } peers { permanent_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 44055 } } peers { permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 } }
I20260806 11:46:58.486243 703 heartbeater.cc:503] Master 127.26.172.254:41337 was elected leader, sending a full tablet report...
I20260806 11:46:58.486666 1069 ts_tablet_manager.cc:1428] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e: Time spent starting tablet: real 0.008s user 0.008s sys 0.001s
W20260806 11:46:58.493436 704 tablet.cc:2369] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:46:58.546176 875 tablet.cc:2369] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:46:58.585654 1075 raft_consensus.cc:482] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:58.585980 1075 raft_consensus.cc:504] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 } } peers { permanent_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 44055 } } peers { permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 } }
I20260806 11:46:58.587791 1075 leader_election.cc:288] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3a75e57336a4e1392f1f5c182347b4e (127.26.172.193:36763), c00f1ff042474dc5a3cc03a99505230e (127.26.172.195:38713)
I20260806 11:46:58.595237 1066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.589189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:37017 (local address 127.26.172.195:38713)
0806 11:46:58.589386 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:58.589390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:58.589416 (+ 26us) server_negotiation.cc:407] Connection header received
0806 11:46:58.589671 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:58.589674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:58.589725 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:58.589810 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:58.590284 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.591188 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.593436 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.594161 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.594337 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.594403 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:58.594976 (+ 573us) server_negotiation.cc:299] Negotiation successful
0806 11:46:58.595073 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 11:46:58.595237 1061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.588585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:51453 (local address 127.26.172.193:36763)
0806 11:46:58.588791 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:58.588796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:58.588934 (+ 138us) server_negotiation.cc:407] Connection header received
0806 11:46:58.589361 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:58.589367 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:58.589454 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:58.589550 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:46:58.590368 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.591189 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.593437 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.594161 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.594337 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.594403 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:58.594976 (+ 573us) server_negotiation.cc:299] Negotiation successful
0806 11:46:58.595075 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 11:46:58.595580 1080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.588959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:38713 (local address 127.26.172.194:37017)
0806 11:46:58.589309 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:58.589327 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:58.589465 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:58.589848 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:58.589850 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:58.589862 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:58.590080 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.590086 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.591372 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.591377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.593196 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.593213 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.594405 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.594410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.594608 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.594769 (+ 161us) client_negotiation.cc:769] Sending connection context
0806 11:46:58.594950 (+ 181us) client_negotiation.cc:240] Negotiation successful
0806 11:46:58.595098 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":302,"spinlock_wait_cycles":2304,"thread_start_us":92,"threads_started":1}
I20260806 11:46:58.595582 1079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.588428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:36763 (local address 127.26.172.194:51453)
0806 11:46:58.588762 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:58.588824 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:58.588975 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:58.589816 (+ 841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:58.589822 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:58.589845 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:46:58.590072 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.590081 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.591372 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.591377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.593196 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:46:58.593213 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.594405 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.594410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:46:58.594613 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.594769 (+ 156us) client_negotiation.cc:769] Sending connection context
0806 11:46:58.594921 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 11:46:58.595098 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":284,"spinlock_wait_cycles":14464,"thread_start_us":121,"threads_started":1}
I20260806 11:46:58.596877 644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f26d605d2b254ab9b3d97f40896345bc" candidate_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a75e57336a4e1392f1f5c182347b4e" is_pre_election: true
I20260806 11:46:58.596874 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f26d605d2b254ab9b3d97f40896345bc" candidate_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00f1ff042474dc5a3cc03a99505230e" is_pre_election: true
I20260806 11:46:58.597280 989 raft_consensus.cc:2454] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ebe24f33c8c4b9eabc322ca9ab8b476 in term 0.
I20260806 11:46:58.597280 644 raft_consensus.cc:2454] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ebe24f33c8c4b9eabc322ca9ab8b476 in term 0.
I20260806 11:46:58.597971 728 leader_election.cc:302] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ebe24f33c8c4b9eabc322ca9ab8b476, c00f1ff042474dc5a3cc03a99505230e; no voters:
I20260806 11:46:58.598328 1075 raft_consensus.cc:2781] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:58.598479 1075 raft_consensus.cc:482] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:58.598542 1075 raft_consensus.cc:3037] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:58.600373 1075 raft_consensus.cc:504] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 } } peers { permanent_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 44055 } } peers { permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 } }
I20260806 11:46:58.600858 1075 leader_election.cc:288] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [CANDIDATE]: Term 1 election: Requested vote from peers e3a75e57336a4e1392f1f5c182347b4e (127.26.172.193:36763), c00f1ff042474dc5a3cc03a99505230e (127.26.172.195:38713)
I20260806 11:46:58.601517 644 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f26d605d2b254ab9b3d97f40896345bc" candidate_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3a75e57336a4e1392f1f5c182347b4e"
I20260806 11:46:58.601557 989 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f26d605d2b254ab9b3d97f40896345bc" candidate_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c00f1ff042474dc5a3cc03a99505230e"
I20260806 11:46:58.601668 644 raft_consensus.cc:3037] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:58.601750 989 raft_consensus.cc:3037] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:58.603297 989 raft_consensus.cc:2454] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ebe24f33c8c4b9eabc322ca9ab8b476 in term 1.
I20260806 11:46:58.603318 644 raft_consensus.cc:2454] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ebe24f33c8c4b9eabc322ca9ab8b476 in term 1.
I20260806 11:46:58.603770 728 leader_election.cc:302] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ebe24f33c8c4b9eabc322ca9ab8b476, c00f1ff042474dc5a3cc03a99505230e; no voters:
I20260806 11:46:58.604012 1075 raft_consensus.cc:2781] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:58.604346 1075 raft_consensus.cc:686] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 1 LEADER]: Becoming Leader. State: Replica: 9ebe24f33c8c4b9eabc322ca9ab8b476, State: Running, Role: LEADER
I20260806 11:46:58.604914 1075 consensus_queue.cc:237] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 } } peers { permanent_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 44055 } } peers { permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 } }
I20260806 11:46:58.609686 460 catalog_manager.cc:5495] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ebe24f33c8c4b9eabc322ca9ab8b476 (127.26.172.194). New cstate: current_term: 1 leader_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ebe24f33c8c4b9eabc322ca9ab8b476" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 44055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 } health_report { overall_health: UNKNOWN } } }
W20260806 11:46:58.626605 1045 tablet.cc:2369] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:46:58.649410 1064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.644530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51436 (local address 127.26.172.194:44055)
0806 11:46:58.644773 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:58.644777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:58.644800 (+ 23us) server_negotiation.cc:407] Connection header received
0806 11:46:58.644925 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:58.644928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:58.645012 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:58.645147 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:46:58.645524 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.646215 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.647224 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:46:58.647486 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:46:58.647598 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:46:58.648150 (+ 552us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:46:58.648877 (+ 727us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:46:58.649005 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:58.649162 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 11:46:58.649242 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260806 11:46:58.658330 989 raft_consensus.cc:1261] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e [term 1 FOLLOWER]: Refusing update from remote peer 9ebe24f33c8c4b9eabc322ca9ab8b476: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:58.658353 644 raft_consensus.cc:1261] T f26d605d2b254ab9b3d97f40896345bc P e3a75e57336a4e1392f1f5c182347b4e [term 1 FOLLOWER]: Refusing update from remote peer 9ebe24f33c8c4b9eabc322ca9ab8b476: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:58.659386 1075 consensus_queue.cc:1035] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a75e57336a4e1392f1f5c182347b4e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 36763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:58.659782 1082 consensus_queue.cc:1035] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c00f1ff042474dc5a3cc03a99505230e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:58.671283 1086 mvcc.cc:205] Tried to move back new op lower bound from 7315524889213607936 to 7315524889009364992. Current Snapshot: MvccSnapshot[applied={T|T < 7315524889213607936}]
I20260806 11:46:58.672341 1087 mvcc.cc:205] Tried to move back new op lower bound from 7315524889213607936 to 7315524889009364992. Current Snapshot: MvccSnapshot[applied={T|T < 7315524889213607936}]
I20260806 11:46:58.682261 460 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:58.682516 460 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:58.686172 460 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3bb68695c3b84c3aab859b054ab448a0: Sending DeleteTablet for 3 replicas of tablet f26d605d2b254ab9b3d97f40896345bc
I20260806 11:46:58.687526 618 tablet_service.cc:1514] Processing DeleteTablet for tablet f26d605d2b254ab9b3d97f40896345bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:58 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:47334
I20260806 11:46:58.687654 793 tablet_service.cc:1514] Processing DeleteTablet for tablet f26d605d2b254ab9b3d97f40896345bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:58 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:60242
I20260806 11:46:58.688277 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 540
I20260806 11:46:58.688598 963 tablet_service.cc:1514] Processing DeleteTablet for tablet f26d605d2b254ab9b3d97f40896345bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:58 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:53938
I20260806 11:46:58.691339 1100 tablet_replica.cc:330] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: stopping tablet replica
I20260806 11:46:58.691862 1100 raft_consensus.cc:2229] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:58.692466 1100 raft_consensus.cc:2258] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:58.692657 1099 tablet_replica.cc:330] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: stopping tablet replica
I20260806 11:46:58.693168 1099 raft_consensus.cc:2229] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:46:58.693806 1099 raft_consensus.cc:2258] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:58.694903 1100 ts_tablet_manager.cc:1905] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:58.698146 1099 ts_tablet_manager.cc:1905] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:58.699506 1100 ts_tablet_manager.cc:1918] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:46:58.699685 1100 log.cc:1196] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/f26d605d2b254ab9b3d97f40896345bc
I20260806 11:46:58.700668 1100 ts_tablet_manager.cc:1939] T f26d605d2b254ab9b3d97f40896345bc P c00f1ff042474dc5a3cc03a99505230e: Deleting consensus metadata
I20260806 11:46:58.702747 1099 ts_tablet_manager.cc:1918] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:46:58.702745 440 catalog_manager.cc:4841] TS c00f1ff042474dc5a3cc03a99505230e (127.26.172.195:38713): tablet f26d605d2b254ab9b3d97f40896345bc (table test-table [id=9c9b2bfcc7fc42c681b6774053b6a83c]) successfully deleted
I20260806 11:46:58.702973 1099 log.cc:1196] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/f26d605d2b254ab9b3d97f40896345bc
I20260806 11:46:58.703387 1099 ts_tablet_manager.cc:1939] T f26d605d2b254ab9b3d97f40896345bc P 9ebe24f33c8c4b9eabc322ca9ab8b476: Deleting consensus metadata
I20260806 11:46:58.705852 440 catalog_manager.cc:4841] TS 9ebe24f33c8c4b9eabc322ca9ab8b476 (127.26.172.194:44055): tablet f26d605d2b254ab9b3d97f40896345bc (table test-table [id=9c9b2bfcc7fc42c681b6774053b6a83c]) successfully deleted
W20260806 11:46:58.707810 440 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:36763 (error 108)
I20260806 11:46:58.709297 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 710
I20260806 11:46:58.709441 1059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:58.708908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:36763 (local address 127.0.0.1:47688)
0806 11:46:58.709133 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:58.709242 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:36763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 11:46:58.716559 440 catalog_manager.cc:4584] TS e3a75e57336a4e1392f1f5c182347b4e (127.26.172.193:36763): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f26d605d2b254ab9b3d97f40896345bc: Network error: Client connection negotiation failed: client connection to 127.26.172.193:36763: connect: Connection refused (error 111)
I20260806 11:46:58.728538 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 880
I20260806 11:46:58.749590 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 417
2026-08-06T11:46:58Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (3132 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T11:46:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:46:58Z Disabled control of system clock
I20260806 11:46:58.802616 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:34511
--webserver_interface=127.26.172.254
--webserver_port=0
--builtin_ntp_servers=127.26.172.212:40217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:34511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 11:46:58.944193 1105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:58.944566 1105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:58.944610 1105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:58.948951 1105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:46:58.949051 1105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:58.949069 1105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:58.949086 1105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:46:58.949102 1105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:46:58.954897 1105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:40217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:34511
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:34511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:58.956408 1105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:58.958160 1105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:58.970078 1110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:58.970229 1105 server_base.cc:1034] running on GCE node
W20260806 11:46:58.970151 1114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:58.970410 1111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:58.971592 1105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:58.973093 1105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:58.976506 1105 hybrid_clock.cc:648] HybridClock initialized: now 1786016818976473 us; error 112 us; skew 500 ppm
I20260806 11:46:58.979491 1105 webserver.cc:460] Webserver started at http://127.26.172.254:41945/ using document root <none> and password file <none>
I20260806 11:46:58.980253 1105 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:58.980376 1105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:58.980670 1105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:58.983152 1105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "1e2297f612494cdf9febf45eacc9252f"
format_stamp: "Formatted at 2026-08-06 11:46:58 on dist-test-slave-7z32"
server_key: "ad2dd047230955215c3238b292e03ff1"
server_key_iv: "c54333a0c59477e244f2c2543b575f7b"
server_key_version: "encryptionkey@0"
I20260806 11:46:58.984038 1105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "1e2297f612494cdf9febf45eacc9252f"
format_stamp: "Formatted at 2026-08-06 11:46:58 on dist-test-slave-7z32"
server_key: "ad2dd047230955215c3238b292e03ff1"
server_key_iv: "c54333a0c59477e244f2c2543b575f7b"
server_key_version: "encryptionkey@0"
I20260806 11:46:58.989818 1105 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:46:58.993579 1124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:58.995741 1105 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260806 11:46:58.995993 1105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "1e2297f612494cdf9febf45eacc9252f"
format_stamp: "Formatted at 2026-08-06 11:46:58 on dist-test-slave-7z32"
server_key: "ad2dd047230955215c3238b292e03ff1"
server_key_iv: "c54333a0c59477e244f2c2543b575f7b"
server_key_version: "encryptionkey@0"
I20260806 11:46:58.996205 1105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:59.002384 1105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:59.003260 1105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:59.003530 1105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:59.014528 1105 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:34511
I20260806 11:46:59.014459 1192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:34511 every 8 connection(s)
I20260806 11:46:59.016047 1105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:46:59.021874 1195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:59.024914 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 1105
I20260806 11:46:59.025111 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:46:59.025473 27315 external_mini_cluster.cc:1428] Setting key 8707fa6d09237f0b76181298b8ca15db
I20260806 11:46:59.033723 1195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f: Bootstrap starting.
I20260806 11:46:59.033797 1199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.028140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49516 (local address 127.26.172.254:34511)
0806 11:46:59.029059 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.029079 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.029125 (+ 46us) server_negotiation.cc:407] Connection header received
0806 11:46:59.030025 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.030050 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.030509 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.030979 (+ 470us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.032142 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.032148 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.032165 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.032179 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.032252 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.032273 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.032469 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.032570 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.032872 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":180,"threads_started":1}
I20260806 11:46:59.038012 1195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:59.039362 1195 log.cc:824] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:59.043133 1195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f: No bootstrap required, opened a new log
I20260806 11:46:59.049217 1195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2297f612494cdf9febf45eacc9252f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34511 } }
I20260806 11:46:59.049758 1195 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:59.049845 1195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e2297f612494cdf9febf45eacc9252f, State: Initialized, Role: FOLLOWER
I20260806 11:46:59.050566 1195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2297f612494cdf9febf45eacc9252f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34511 } }
I20260806 11:46:59.050809 1195 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:46:59.050987 1195 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:46:59.051149 1195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:59.052718 1195 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2297f612494cdf9febf45eacc9252f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34511 } }
I20260806 11:46:59.053301 1195 leader_election.cc:302] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e2297f612494cdf9febf45eacc9252f; no voters:
I20260806 11:46:59.053812 1195 leader_election.cc:288] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:46:59.054229 1201 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:59.054700 1201 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [term 1 LEADER]: Becoming Leader. State: Replica: 1e2297f612494cdf9febf45eacc9252f, State: Running, Role: LEADER
I20260806 11:46:59.055202 1201 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2297f612494cdf9febf45eacc9252f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34511 } }
I20260806 11:46:59.056108 1195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:46:59.057476 1202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e2297f612494cdf9febf45eacc9252f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2297f612494cdf9febf45eacc9252f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34511 } } }
I20260806 11:46:59.057477 1203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e2297f612494cdf9febf45eacc9252f. Latest consensus state: current_term: 1 leader_uuid: "1e2297f612494cdf9febf45eacc9252f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e2297f612494cdf9febf45eacc9252f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34511 } } }
I20260806 11:46:59.057714 1202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:59.057749 1203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f [sys.catalog]: This master's current role is: LEADER
I20260806 11:46:59.058558 1211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:46:59.062400 1211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:46:59.070374 1211 catalog_manager.cc:1347] Generated new cluster ID: 5857c0185d364e83a333f8d4bfa2260d
I20260806 11:46:59.070575 1211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:46:59.095996 1211 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:46:59.096681 1211 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:46:59.104585 1211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f: Generated new TSK 0
I20260806 11:46:59.105581 1211 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:46:59.118221 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34511
--builtin_ntp_servers=127.26.172.212:40217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 11:46:59.254899 1225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:59.255254 1225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:59.255302 1225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:59.260283 1225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:59.260385 1225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:59.260450 1225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:46:59.265781 1225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:40217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:59.267381 1225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:59.269027 1225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:59.281541 1230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:59.281541 1235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:59.281594 1231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:59.282470 1225 server_base.cc:1034] running on GCE node
I20260806 11:46:59.283394 1225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:59.284456 1225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:59.287871 1225 hybrid_clock.cc:648] HybridClock initialized: now 1786016819287792 us; error 115 us; skew 500 ppm
I20260806 11:46:59.290707 1225 webserver.cc:460] Webserver started at http://127.26.172.193:42003/ using document root <none> and password file <none>
I20260806 11:46:59.291602 1225 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:59.291718 1225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:59.291996 1225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:59.294452 1225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "1407932801d04aeca2a8d3b32da0ce0d"
format_stamp: "Formatted at 2026-08-06 11:46:59 on dist-test-slave-7z32"
server_key: "d43900eab384b1e73401b7a0f04d9557"
server_key_iv: "fed92aa01f9503e619379757f583c772"
server_key_version: "encryptionkey@0"
I20260806 11:46:59.295209 1225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "1407932801d04aeca2a8d3b32da0ce0d"
format_stamp: "Formatted at 2026-08-06 11:46:59 on dist-test-slave-7z32"
server_key: "d43900eab384b1e73401b7a0f04d9557"
server_key_iv: "fed92aa01f9503e619379757f583c772"
server_key_version: "encryptionkey@0"
I20260806 11:46:59.300787 1225 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260806 11:46:59.304939 1242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:59.307166 1225 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:46:59.307382 1225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "1407932801d04aeca2a8d3b32da0ce0d"
format_stamp: "Formatted at 2026-08-06 11:46:59 on dist-test-slave-7z32"
server_key: "d43900eab384b1e73401b7a0f04d9557"
server_key_iv: "fed92aa01f9503e619379757f583c772"
server_key_version: "encryptionkey@0"
I20260806 11:46:59.307538 1225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:59.313310 1225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:59.314113 1225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:59.314299 1225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:59.314994 1225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:59.316102 1225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:59.316160 1225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:59.316205 1225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:59.316221 1225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:59.327993 1225 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:46693
I20260806 11:46:59.328260 1387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:46693 every 8 connection(s)
I20260806 11:46:59.329499 1225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:46:59.339767 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 1225
I20260806 11:46:59.340126 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:46:59.340585 27315 external_mini_cluster.cc:1428] Setting key fe132ac099ae9bcd1e2b9d8ada67bf7d
I20260806 11:46:59.341706 1199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.332810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:52271 (local address 127.26.172.254:34511)
0806 11:46:59.333044 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.333056 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.334898 (+ 1842us) server_negotiation.cc:407] Connection header received
0806 11:46:59.337061 (+ 2163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.337066 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.337142 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.337269 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.340961 (+ 3692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.340967 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.340970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.340994 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.341032 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.341046 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.341194 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.341481 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.341553 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 11:46:59.343252 1391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.333253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34511 (local address 127.26.172.193:52271)
0806 11:46:59.334610 (+ 1357us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:59.334684 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:59.336540 (+ 1856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:59.337575 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:59.337586 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:59.337802 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:59.340299 (+ 2497us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:46:59.340302 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:59.340437 (+ 135us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:46:59.340621 (+ 184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:59.341228 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:59.341260 (+ 32us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:59.341270 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 11:46:59.341559 (+ 289us) client_negotiation.cc:240] Negotiation successful
0806 11:46:59.341958 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":205,"threads_started":1}
I20260806 11:46:59.343966 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34511
--builtin_ntp_servers=127.26.172.212:40217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 11:46:59.345527 1388 heartbeater.cc:347] Connected to a master server at 127.26.172.254:34511
I20260806 11:46:59.345985 1388 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:59.346855 1388 heartbeater.cc:511] Master 127.26.172.254:34511 requested a full tablet report, sending...
I20260806 11:46:59.350173 1147 ts_manager.cc:194] Registered new tserver with Master: 1407932801d04aeca2a8d3b32da0ce0d (127.26.172.193:46693)
W20260806 11:46:59.473237 1392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:59.473618 1392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:59.473698 1392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:59.478000 1392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:59.478133 1392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:59.478242 1392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:46:59.484535 1392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:40217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:59.486169 1392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:59.488240 1392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:59.500645 1399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:59.500550 1398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:59.500730 1401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:59.501794 1392 server_base.cc:1034] running on GCE node
I20260806 11:46:59.502480 1392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:59.503623 1392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:59.504884 1392 hybrid_clock.cc:648] HybridClock initialized: now 1786016819504832 us; error 64 us; skew 500 ppm
I20260806 11:46:59.508015 1392 webserver.cc:460] Webserver started at http://127.26.172.194:41821/ using document root <none> and password file <none>
I20260806 11:46:59.508836 1392 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:59.508917 1392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:59.509253 1392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:59.512326 1392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "ba636c506d8543a4b20ba2895cb61a1f"
format_stamp: "Formatted at 2026-08-06 11:46:59 on dist-test-slave-7z32"
server_key: "9aac69708ad6a30407a9cca3800df251"
server_key_iv: "4f498a29f5abc8db27dc92026a9d15ac"
server_key_version: "encryptionkey@0"
I20260806 11:46:59.513064 1392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "ba636c506d8543a4b20ba2895cb61a1f"
format_stamp: "Formatted at 2026-08-06 11:46:59 on dist-test-slave-7z32"
server_key: "9aac69708ad6a30407a9cca3800df251"
server_key_iv: "4f498a29f5abc8db27dc92026a9d15ac"
server_key_version: "encryptionkey@0"
I20260806 11:46:59.518795 1392 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:46:59.523150 1408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:59.525430 1392 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260806 11:46:59.525689 1392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "ba636c506d8543a4b20ba2895cb61a1f"
format_stamp: "Formatted at 2026-08-06 11:46:59 on dist-test-slave-7z32"
server_key: "9aac69708ad6a30407a9cca3800df251"
server_key_iv: "4f498a29f5abc8db27dc92026a9d15ac"
server_key_version: "encryptionkey@0"
I20260806 11:46:59.525952 1392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:59.532462 1392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:59.533406 1392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:59.533658 1392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:59.534452 1392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:59.535907 1392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:59.535966 1392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:59.536015 1392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:59.536031 1392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:59.550057 1392 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:39809
I20260806 11:46:59.550169 1555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:39809 every 8 connection(s)
I20260806 11:46:59.551810 1392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:46:59.555939 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 1392
I20260806 11:46:59.556135 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:46:59.556520 27315 external_mini_cluster.cc:1428] Setting key b086435aa0fc892e2d83e689aa27d87b
I20260806 11:46:59.559508 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34511
--builtin_ntp_servers=127.26.172.212:40217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 11:46:59.561434 1199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.554602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:56287 (local address 127.26.172.254:34511)
0806 11:46:59.554754 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.554758 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.556701 (+ 1943us) server_negotiation.cc:407] Connection header received
0806 11:46:59.558961 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.558964 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.559010 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.559128 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.560785 (+ 1657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.560793 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.560799 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.560819 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.560851 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.560867 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.561003 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.561176 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.561233 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 11:46:59.562752 1558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.555314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34511 (local address 127.26.172.194:56287)
0806 11:46:59.556440 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:59.556513 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:59.558609 (+ 2096us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:59.559329 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:59.559338 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:59.559465 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:59.560414 (+ 949us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:46:59.560416 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:59.560476 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:46:59.560576 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:59.560996 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:59.561004 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:59.561010 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 11:46:59.561204 (+ 194us) client_negotiation.cc:240] Negotiation successful
0806 11:46:59.561582 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":285,"threads_started":1}
I20260806 11:46:59.565119 1556 heartbeater.cc:347] Connected to a master server at 127.26.172.254:34511
I20260806 11:46:59.565544 1556 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:59.566179 1556 heartbeater.cc:511] Master 127.26.172.254:34511 requested a full tablet report, sending...
I20260806 11:46:59.568049 1147 ts_manager.cc:194] Registered new tserver with Master: ba636c506d8543a4b20ba2895cb61a1f (127.26.172.194:39809)
W20260806 11:46:59.726120 1559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:46:59.726588 1559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:46:59.726639 1559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:46:59.731875 1559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:46:59.732013 1559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:46:59.732141 1559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:46:59.738509 1559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:40217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:46:59.740312 1559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:46:59.742487 1559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:46:59.756426 1565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:59.756788 1559 server_base.cc:1034] running on GCE node
W20260806 11:46:59.756426 1570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:46:59.756433 1566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:46:59.757795 1559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:46:59.759042 1559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:46:59.760329 1559 hybrid_clock.cc:648] HybridClock initialized: now 1786016819760282 us; error 62 us; skew 500 ppm
I20260806 11:46:59.763566 1559 webserver.cc:460] Webserver started at http://127.26.172.195:38297/ using document root <none> and password file <none>
I20260806 11:46:59.764513 1559 fs_manager.cc:359] Metadata directory not provided
I20260806 11:46:59.764603 1559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:46:59.765089 1559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:46:59.768584 1559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "94f4522ceca64e0ebbcc7acb5f496c87"
format_stamp: "Formatted at 2026-08-06 11:46:59 on dist-test-slave-7z32"
server_key: "64dd10c7ecd0cb72fb0d3c8ae8e8c0ec"
server_key_iv: "21d226bf5fe279698c4e08227f989712"
server_key_version: "encryptionkey@0"
I20260806 11:46:59.769546 1559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "94f4522ceca64e0ebbcc7acb5f496c87"
format_stamp: "Formatted at 2026-08-06 11:46:59 on dist-test-slave-7z32"
server_key: "64dd10c7ecd0cb72fb0d3c8ae8e8c0ec"
server_key_iv: "21d226bf5fe279698c4e08227f989712"
server_key_version: "encryptionkey@0"
I20260806 11:46:59.776237 1559 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 11:46:59.781154 1577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:59.783702 1559 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260806 11:46:59.783977 1559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "94f4522ceca64e0ebbcc7acb5f496c87"
format_stamp: "Formatted at 2026-08-06 11:46:59 on dist-test-slave-7z32"
server_key: "64dd10c7ecd0cb72fb0d3c8ae8e8c0ec"
server_key_iv: "21d226bf5fe279698c4e08227f989712"
server_key_version: "encryptionkey@0"
I20260806 11:46:59.784209 1559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:46:59.790979 1559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:46:59.792030 1559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:46:59.792315 1559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:46:59.793431 1559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:46:59.795063 1559 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:46:59.795133 1559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:59.795192 1559 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:46:59.795208 1559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:46:59.809274 1559 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:38079
I20260806 11:46:59.809299 1719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:38079 every 8 connection(s)
I20260806 11:46:59.810773 1559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:46:59.812604 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 1559
I20260806 11:46:59.812817 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:46:59.813185 27315 external_mini_cluster.cc:1428] Setting key 4ef73aedc6fae158d12716a0c2c2eac6
I20260806 11:46:59.820885 1199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.814379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:38493 (local address 127.26.172.254:34511)
0806 11:46:59.814553 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.814557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.816767 (+ 2210us) server_negotiation.cc:407] Connection header received
0806 11:46:59.818597 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.818601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.818659 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.818770 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.820276 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.820280 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.820283 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.820300 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.820334 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.820344 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.820463 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.820645 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.820718 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 11:46:59.822094 1723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.815233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34511 (local address 127.26.172.195:38493)
0806 11:46:59.816578 (+ 1345us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:59.816645 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:59.818278 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:59.819038 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:59.819047 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:59.819168 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:59.819934 (+ 766us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:46:59.819936 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:59.819989 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:46:59.820087 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:59.820442 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:59.820452 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:59.820459 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 11:46:59.820713 (+ 254us) client_negotiation.cc:240] Negotiation successful
0806 11:46:59.821047 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":234,"threads_started":1}
I20260806 11:46:59.824554 1720 heartbeater.cc:347] Connected to a master server at 127.26.172.254:34511
I20260806 11:46:59.824900 1720 heartbeater.cc:464] Registering TS with master...
I20260806 11:46:59.825449 1720 heartbeater.cc:511] Master 127.26.172.254:34511 requested a full tablet report, sending...
I20260806 11:46:59.827207 1147 ts_manager.cc:194] Registered new tserver with Master: 94f4522ceca64e0ebbcc7acb5f496c87 (127.26.172.195:38079)
I20260806 11:46:59.830266 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:46:59.835368 1199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.833108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49528 (local address 127.26.172.254:34511)
0806 11:46:59.833280 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.833288 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.833578 (+ 290us) server_negotiation.cc:407] Connection header received
0806 11:46:59.833773 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.833777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.833828 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.833933 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.834862 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.834866 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.834869 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.834885 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.834911 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.834932 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.835048 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.835149 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.835197 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 11:46:59.839763 1147 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49528:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:46:59.843590 1147 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:46:59.862473 1735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.858155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:46693 (local address 127.0.0.1:52468)
0806 11:46:59.859086 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:59.859162 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:59.859307 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:59.860146 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:59.860154 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:59.860252 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:59.860989 (+ 737us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:46:59.860994 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:59.861024 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:46:59.861115 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:59.861974 (+ 859us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:59.861993 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:59.862004 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 11:46:59.862157 (+ 153us) client_negotiation.cc:240] Negotiation successful
0806 11:46:59.862249 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":151,"threads_started":1}
I20260806 11:46:59.862517 1736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.858401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52468 (local address 127.26.172.193:46693)
0806 11:46:59.859093 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.859104 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.859465 (+ 361us) server_negotiation.cc:407] Connection header received
0806 11:46:59.859559 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.859567 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.859878 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.860069 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.861722 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.861729 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.861748 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.861761 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.861814 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.861842 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.862013 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.862210 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.862341 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":171,"threads_started":1}
I20260806 11:46:59.863343 1737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.858813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:38079 (local address 127.0.0.1:53180)
0806 11:46:59.859635 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:59.859649 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:59.859731 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:59.861187 (+ 1456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:59.861194 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:59.861223 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:59.861754 (+ 531us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:46:59.861759 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:59.861773 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:46:59.861809 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:59.863016 (+ 1207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:59.863020 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:59.863025 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 11:46:59.863146 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 11:46:59.863196 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"mutex_wait_us":4,"thread_start_us":195,"threads_started":1}
I20260806 11:46:59.863720 1738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.859249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:39809 (local address 127.0.0.1:46350)
0806 11:46:59.859912 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:59.859927 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:59.860002 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:59.861684 (+ 1682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:59.861692 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:59.861712 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:59.862952 (+ 1240us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:46:59.862956 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:59.862969 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:46:59.862998 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:59.863372 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:59.863376 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:59.863379 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 11:46:59.863461 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 11:46:59.863510 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":149,"threads_started":1}
I20260806 11:46:59.863893 1743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.859524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53180 (local address 127.26.172.195:38079)
0806 11:46:59.860240 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.860254 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.860276 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:46:59.860326 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.860334 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.860983 (+ 649us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.862039 (+ 1056us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.862712 (+ 673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.862718 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.862734 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.862744 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.862800 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.862886 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.863018 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.863478 (+ 460us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.863704 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":174,"threads_started":1}
I20260806 11:46:59.864279 1740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.859454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46350 (local address 127.26.172.194:39809)
0806 11:46:59.860188 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.860206 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.860243 (+ 37us) server_negotiation.cc:407] Connection header received
0806 11:46:59.860327 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.860334 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.860611 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.860804 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.863123 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.863129 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.863140 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.863154 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.863200 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.863244 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.863377 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.864052 (+ 675us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.864130 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":145,"threads_started":1}
I20260806 11:46:59.867700 1637 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6d845b48f849819aef9ef111b592ce (DEFAULT_TABLE table=test-table [id=9353478ee0e246cc8ff29ac02178f894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:59.867759 1303 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6d845b48f849819aef9ef111b592ce (DEFAULT_TABLE table=test-table [id=9353478ee0e246cc8ff29ac02178f894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:59.867761 1467 tablet_service.cc:1467] Processing CreateTablet for tablet 0d6d845b48f849819aef9ef111b592ce (DEFAULT_TABLE table=test-table [id=9353478ee0e246cc8ff29ac02178f894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:46:59.869138 1637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6d845b48f849819aef9ef111b592ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:59.869403 1303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6d845b48f849819aef9ef111b592ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:59.869403 1467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d6d845b48f849819aef9ef111b592ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:46:59.876746 1744 tablet_bootstrap.cc:492] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: Bootstrap starting.
I20260806 11:46:59.879597 1744 tablet_bootstrap.cc:654] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:59.880738 1744 log.cc:824] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:59.881086 1745 tablet_bootstrap.cc:492] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d: Bootstrap starting.
I20260806 11:46:59.881783 1746 tablet_bootstrap.cc:492] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: Bootstrap starting.
I20260806 11:46:59.884102 1744 tablet_bootstrap.cc:492] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: No bootstrap required, opened a new log
I20260806 11:46:59.884352 1746 tablet_bootstrap.cc:654] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:59.884418 1745 tablet_bootstrap.cc:654] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d: Neither blocks nor log segments found. Creating new log.
I20260806 11:46:59.884445 1744 ts_tablet_manager.cc:1397] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 11:46:59.885527 1746 log.cc:824] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:59.885529 1745 log.cc:824] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d: Log is configured to *not* fsync() on all Append() calls
I20260806 11:46:59.888247 1745 tablet_bootstrap.cc:492] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d: No bootstrap required, opened a new log
I20260806 11:46:59.888247 1746 tablet_bootstrap.cc:492] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: No bootstrap required, opened a new log
I20260806 11:46:59.888506 1745 ts_tablet_manager.cc:1397] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 11:46:59.888553 1746 ts_tablet_manager.cc:1397] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260806 11:46:59.889813 1744 raft_consensus.cc:348] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 } } peers { permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 } } peers { permanent_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38079 } }
I20260806 11:46:59.890277 1744 raft_consensus.cc:374] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:59.890383 1744 raft_consensus.cc:729] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f4522ceca64e0ebbcc7acb5f496c87, State: Initialized, Role: FOLLOWER
I20260806 11:46:59.891232 1744 consensus_queue.cc:260] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 } } peers { permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 } } peers { permanent_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38079 } }
I20260806 11:46:59.892506 1752 raft_consensus.cc:482] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:46:59.892729 1744 ts_tablet_manager.cc:1428] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260806 11:46:59.892730 1752 raft_consensus.cc:504] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 } } peers { permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 } } peers { permanent_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38079 } }
I20260806 11:46:59.893373 1720 heartbeater.cc:503] Master 127.26.172.254:34511 was elected leader, sending a full tablet report...
I20260806 11:46:59.894160 1745 raft_consensus.cc:348] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 } } peers { permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 } } peers { permanent_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38079 } }
I20260806 11:46:59.894160 1746 raft_consensus.cc:348] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 } } peers { permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 } } peers { permanent_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38079 } }
I20260806 11:46:59.894539 1745 raft_consensus.cc:374] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:59.894596 1745 raft_consensus.cc:729] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1407932801d04aeca2a8d3b32da0ce0d, State: Initialized, Role: FOLLOWER
I20260806 11:46:59.895193 1745 consensus_queue.cc:260] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 } } peers { permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 } } peers { permanent_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38079 } }
I20260806 11:46:59.895480 1752 leader_election.cc:288] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1407932801d04aeca2a8d3b32da0ce0d (127.26.172.193:46693), ba636c506d8543a4b20ba2895cb61a1f (127.26.172.194:39809)
I20260806 11:46:59.895849 1746 raft_consensus.cc:374] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:46:59.895957 1746 raft_consensus.cc:729] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba636c506d8543a4b20ba2895cb61a1f, State: Initialized, Role: FOLLOWER
I20260806 11:46:59.896610 1745 ts_tablet_manager.cc:1428] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260806 11:46:59.897233 1746 consensus_queue.cc:260] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 } } peers { permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 } } peers { permanent_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38079 } }
I20260806 11:46:59.897433 1388 heartbeater.cc:503] Master 127.26.172.254:34511 was elected leader, sending a full tablet report...
I20260806 11:46:59.897814 1723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.894672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:46693 (local address 127.26.172.195:58565)
0806 11:46:59.895070 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:59.895091 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:59.895230 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:59.896276 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:59.896280 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:59.896301 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:59.896967 (+ 666us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:46:59.896969 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:59.896984 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:46:59.897018 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:59.897484 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:59.897492 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:59.897498 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 11:46:59.897604 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 11:46:59.897662 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197}
I20260806 11:46:59.898419 1746 ts_tablet_manager.cc:1428] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260806 11:46:59.898782 1556 heartbeater.cc:503] Master 127.26.172.254:34511 was elected leader, sending a full tablet report...
I20260806 11:46:59.899416 1736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.894783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:58565 (local address 127.26.172.193:46693)
0806 11:46:59.895952 (+ 1169us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.895958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.895979 (+ 21us) server_negotiation.cc:407] Connection header received
0806 11:46:59.896039 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.896042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.896087 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.896184 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.897195 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.897201 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.897205 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.897222 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.897255 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.897267 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.897380 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.899192 (+ 1812us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.899256 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1042}
I20260806 11:46:59.900125 1334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d6d845b48f849819aef9ef111b592ce" candidate_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1407932801d04aeca2a8d3b32da0ce0d" is_pre_election: true
I20260806 11:46:59.900599 1334 raft_consensus.cc:2454] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94f4522ceca64e0ebbcc7acb5f496c87 in term 0.
I20260806 11:46:59.901820 1578 leader_election.cc:302] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1407932801d04aeca2a8d3b32da0ce0d, 94f4522ceca64e0ebbcc7acb5f496c87; no voters:
I20260806 11:46:59.902350 1753 raft_consensus.cc:2781] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:46:59.902484 1753 raft_consensus.cc:482] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:46:59.902580 1753 raft_consensus.cc:3037] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:59.902603 1740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.895599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:57701 (local address 127.26.172.194:39809)
0806 11:46:59.895722 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.895726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.898194 (+ 2468us) server_negotiation.cc:407] Connection header received
0806 11:46:59.898282 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.898286 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.898357 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.898435 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.901335 (+ 2900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.901340 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.901348 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.901367 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.901397 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.901409 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.901520 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.902422 (+ 902us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.902466 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 11:46:59.902894 1723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.895194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:39809 (local address 127.26.172.195:57701)
0806 11:46:59.897989 (+ 2795us) negotiation.cc:107] Waiting for socket to connect
0806 11:46:59.898006 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:46:59.898090 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:46:59.900462 (+ 2372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:46:59.900466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:46:59.900490 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:46:59.901069 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:46:59.901071 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:46:59.901082 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:46:59.901156 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:46:59.902278 (+ 1122us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:46:59.902281 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:46:59.902285 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 11:46:59.902384 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 11:46:59.902437 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2730,"thread_start_us":136,"threads_started":1}
I20260806 11:46:59.903843 1493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d6d845b48f849819aef9ef111b592ce" candidate_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba636c506d8543a4b20ba2895cb61a1f" is_pre_election: true
I20260806 11:46:59.904186 1493 raft_consensus.cc:2454] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94f4522ceca64e0ebbcc7acb5f496c87 in term 0.
I20260806 11:46:59.904727 1753 raft_consensus.cc:504] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 } } peers { permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 } } peers { permanent_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38079 } }
I20260806 11:46:59.905169 1753 leader_election.cc:288] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [CANDIDATE]: Term 1 election: Requested vote from peers 1407932801d04aeca2a8d3b32da0ce0d (127.26.172.193:46693), ba636c506d8543a4b20ba2895cb61a1f (127.26.172.194:39809)
I20260806 11:46:59.905726 1493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d6d845b48f849819aef9ef111b592ce" candidate_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba636c506d8543a4b20ba2895cb61a1f"
I20260806 11:46:59.905751 1334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d6d845b48f849819aef9ef111b592ce" candidate_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1407932801d04aeca2a8d3b32da0ce0d"
I20260806 11:46:59.905839 1493 raft_consensus.cc:3037] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:59.905951 1334 raft_consensus.cc:3037] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:46:59.907301 1493 raft_consensus.cc:2454] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f4522ceca64e0ebbcc7acb5f496c87 in term 1.
I20260806 11:46:59.907696 1578 leader_election.cc:302] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94f4522ceca64e0ebbcc7acb5f496c87, ba636c506d8543a4b20ba2895cb61a1f; no voters:
I20260806 11:46:59.907819 1334 raft_consensus.cc:2454] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94f4522ceca64e0ebbcc7acb5f496c87 in term 1.
I20260806 11:46:59.907941 1753 raft_consensus.cc:2781] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:46:59.908074 1753 raft_consensus.cc:686] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 1 LEADER]: Becoming Leader. State: Replica: 94f4522ceca64e0ebbcc7acb5f496c87, State: Running, Role: LEADER
I20260806 11:46:59.908569 1753 consensus_queue.cc:237] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 } } peers { permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 } } peers { permanent_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38079 } }
I20260806 11:46:59.913825 1147 catalog_manager.cc:5495] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94f4522ceca64e0ebbcc7acb5f496c87 (127.26.172.195). New cstate: current_term: 1 leader_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94f4522ceca64e0ebbcc7acb5f496c87" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38079 } health_report { overall_health: HEALTHY } } }
I20260806 11:46:59.928982 1743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:46:59.926948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53184 (local address 127.26.172.195:38079)
0806 11:46:59.927131 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 11:46:59.927134 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 11:46:59.927152 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:46:59.927252 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:46:59.927254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:46:59.927324 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:46:59.927514 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:46:59.928461 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:46:59.928464 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:46:59.928466 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:46:59.928478 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:46:59.928500 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:46:59.928510 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:46:59.928609 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 11:46:59.928766 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 11:46:59.928806 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 11:46:59.937867 1334 raft_consensus.cc:1261] T 0d6d845b48f849819aef9ef111b592ce P 1407932801d04aeca2a8d3b32da0ce0d [term 1 FOLLOWER]: Refusing update from remote peer 94f4522ceca64e0ebbcc7acb5f496c87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:59.937867 1493 raft_consensus.cc:1261] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f [term 1 FOLLOWER]: Refusing update from remote peer 94f4522ceca64e0ebbcc7acb5f496c87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:46:59.939195 1752 consensus_queue.cc:1035] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1407932801d04aeca2a8d3b32da0ce0d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:59.939554 1753 consensus_queue.cc:1035] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba636c506d8543a4b20ba2895cb61a1f" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 39809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:46:59.951486 1761 mvcc.cc:205] Tried to move back new op lower bound from 7315524894454087680 to 7315524894351065088. Current Snapshot: MvccSnapshot[applied={T|T < 7315524894454087680}]
I20260806 11:46:59.952678 1760 mvcc.cc:205] Tried to move back new op lower bound from 7315524894454087680 to 7315524894351065088. Current Snapshot: MvccSnapshot[applied={T|T < 7315524894454087680}]
I20260806 11:46:59.961709 1145 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49528:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:59.961930 1145 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49528:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:46:59.965454 1145 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e2297f612494cdf9febf45eacc9252f: Sending DeleteTablet for 3 replicas of tablet 0d6d845b48f849819aef9ef111b592ce
I20260806 11:46:59.966948 1303 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d6d845b48f849819aef9ef111b592ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:59 UTC) from {username='slave'} at 127.0.0.1:52468
I20260806 11:46:59.967072 1637 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d6d845b48f849819aef9ef111b592ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:59 UTC) from {username='slave'} at 127.0.0.1:53180
I20260806 11:46:59.967475 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 1225
I20260806 11:46:59.968326 1772 tablet_replica.cc:330] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: stopping tablet replica
I20260806 11:46:59.968600 1467 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d6d845b48f849819aef9ef111b592ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:46:59 UTC) from {username='slave'} at 127.0.0.1:46350
I20260806 11:46:59.968878 1772 raft_consensus.cc:2229] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:46:59.969569 1772 raft_consensus.cc:2258] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:59.971531 1773 tablet_replica.cc:330] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: stopping tablet replica
I20260806 11:46:59.972208 1773 raft_consensus.cc:2229] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:46:59.972978 1773 raft_consensus.cc:2258] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:46:59.974918 1772 ts_tablet_manager.cc:1905] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:59.978696 1772 ts_tablet_manager.cc:1918] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:46:59.978900 1772 log.cc:1196] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/0d6d845b48f849819aef9ef111b592ce
I20260806 11:46:59.979336 1772 ts_tablet_manager.cc:1939] T 0d6d845b48f849819aef9ef111b592ce P 94f4522ceca64e0ebbcc7acb5f496c87: Deleting consensus metadata
I20260806 11:46:59.981437 1129 catalog_manager.cc:4841] TS 94f4522ceca64e0ebbcc7acb5f496c87 (127.26.172.195:38079): tablet 0d6d845b48f849819aef9ef111b592ce (table test-table [id=9353478ee0e246cc8ff29ac02178f894]) successfully deleted
I20260806 11:46:59.985320 1773 ts_tablet_manager.cc:1905] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:46:59.989380 1773 ts_tablet_manager.cc:1918] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:46:59.989590 1773 log.cc:1196] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/0d6d845b48f849819aef9ef111b592ce
I20260806 11:46:59.989923 1773 ts_tablet_manager.cc:1939] T 0d6d845b48f849819aef9ef111b592ce P ba636c506d8543a4b20ba2895cb61a1f: Deleting consensus metadata
I20260806 11:46:59.992920 1126 catalog_manager.cc:4841] TS ba636c506d8543a4b20ba2895cb61a1f (127.26.172.194:39809): tablet 0d6d845b48f849819aef9ef111b592ce (table test-table [id=9353478ee0e246cc8ff29ac02178f894]) successfully deleted
W20260806 11:47:00.005324 1126 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:46693 (error 108)
I20260806 11:47:00.005752 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 1392
I20260806 11:47:00.007517 1738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:00.006988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:46693 (local address 127.0.0.1:52484)
0806 11:47:00.007279 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:00.007388 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:46693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
W20260806 11:47:00.007793 1126 catalog_manager.cc:4584] TS 1407932801d04aeca2a8d3b32da0ce0d (127.26.172.193:46693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0d6d845b48f849819aef9ef111b592ce: Network error: Client connection negotiation failed: client connection to 127.26.172.193:46693: connect: Connection refused (error 111)
I20260806 11:47:00.022055 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 1559
I20260806 11:47:00.039747 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 1105
2026-08-06T11:47:00Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1289 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 11:47:00.076771 27315 mini_oidc.cc:152] Starting JWKS server
I20260806 11:47:00.079391 27315 webserver.cc:460] Webserver started at https://127.0.0.1:45453/ using document root <none> and password file <none>
I20260806 11:47:00.079955 27315 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 11:47:00.080469 27315 webserver.cc:460] Webserver started at http://127.0.0.1:34707/ using document root <none> and password file <none>
2026-08-06T11:47:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:00Z Disabled control of system clock
I20260806 11:47:00.096967 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:45137
--webserver_interface=127.26.172.254
--webserver_port=0
--builtin_ntp_servers=127.26.172.212:33679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:45137
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45453/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/testchainca.cert with env {}
W20260806 11:47:00.267001 1782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:00.267454 1782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:00.267506 1782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:00.272979 1782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:00.273121 1782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:00.273140 1782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:00.273160 1782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:00.273178 1782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 11:47:00.273197 1782 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 11:47:00.273211 1782 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45453/jwks.json
I20260806 11:47:00.280604 1782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:33679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:45137
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:45137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45453/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:00.282343 1782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:00.283852 1782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:00.295969 1790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:00.295969 1793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:00.296005 1789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:00.296480 1782 server_base.cc:1034] running on GCE node
I20260806 11:47:00.297264 1782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:00.298929 1782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:00.300156 1782 hybrid_clock.cc:648] HybridClock initialized: now 1786016820300117 us; error 67 us; skew 500 ppm
I20260806 11:47:00.302639 1782 webserver.cc:460] Webserver started at http://127.26.172.254:42273/ using document root <none> and password file <none>
I20260806 11:47:00.303414 1782 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:00.303493 1782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:00.303745 1782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:00.306159 1782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "bc0284efbd524d87abdc189162376e0c"
format_stamp: "Formatted at 2026-08-06 11:47:00 on dist-test-slave-7z32"
server_key: "87a87be9b78c0248b0d0e6a63d4b074d"
server_key_iv: "d3e9e2f59e65716c8417595cdc815a49"
server_key_version: "encryptionkey@0"
I20260806 11:47:00.306869 1782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "bc0284efbd524d87abdc189162376e0c"
format_stamp: "Formatted at 2026-08-06 11:47:00 on dist-test-slave-7z32"
server_key: "87a87be9b78c0248b0d0e6a63d4b074d"
server_key_iv: "d3e9e2f59e65716c8417595cdc815a49"
server_key_version: "encryptionkey@0"
I20260806 11:47:00.312430 1782 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:47:00.315937 1799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:00.317785 1782 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:47:00.317991 1782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "bc0284efbd524d87abdc189162376e0c"
format_stamp: "Formatted at 2026-08-06 11:47:00 on dist-test-slave-7z32"
server_key: "87a87be9b78c0248b0d0e6a63d4b074d"
server_key_iv: "d3e9e2f59e65716c8417595cdc815a49"
server_key_version: "encryptionkey@0"
I20260806 11:47:00.318161 1782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:00.359737 1782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:00.360591 1782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:00.360786 1782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:00.370507 1782 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:45137
I20260806 11:47:00.370589 1866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:45137 every 8 connection(s)
I20260806 11:47:00.371788 1782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:00.376576 1867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:00.380539 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 1782
I20260806 11:47:00.380736 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:00.381132 27315 external_mini_cluster.cc:1428] Setting key ad8251c39da628629afacc8c17612d67
I20260806 11:47:00.385669 1867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c: Bootstrap starting.
I20260806 11:47:00.389031 1867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:00.390130 1867 log.cc:824] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:00.393770 1867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c: No bootstrap required, opened a new log
I20260806 11:47:00.394284 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:00.383185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57086 (local address 127.26.172.254:45137)
0806 11:47:00.384186 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:00.384205 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:00.384253 (+ 48us) server_negotiation.cc:407] Connection header received
0806 11:47:00.385163 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:00.385187 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:00.385723 (+ 536us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:00.386362 (+ 639us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:00.387092 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.388233 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.389286 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.389872 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.390080 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:00.391352 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:00.391359 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:00.391381 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:00.392215 (+ 834us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:00.392318 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:00.392355 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:00.392511 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:00.392696 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 11:47:00.393069 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":206,"threads_started":1}
I20260806 11:47:00.398252 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:47:00.399197 1867 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0284efbd524d87abdc189162376e0c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45137 } }
I20260806 11:47:00.399556 1867 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:00.399614 1867 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0284efbd524d87abdc189162376e0c, State: Initialized, Role: FOLLOWER
I20260806 11:47:00.400158 1867 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0284efbd524d87abdc189162376e0c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45137 } }
I20260806 11:47:00.400354 1867 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:00.400451 1867 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:00.400585 1867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:00.401898 1867 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0284efbd524d87abdc189162376e0c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45137 } }
I20260806 11:47:00.402380 1867 leader_election.cc:302] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc0284efbd524d87abdc189162376e0c; no voters:
I20260806 11:47:00.402895 1867 leader_election.cc:288] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:00.403165 1873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:00.403584 1873 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [term 1 LEADER]: Becoming Leader. State: Replica: bc0284efbd524d87abdc189162376e0c, State: Running, Role: LEADER
I20260806 11:47:00.404094 1873 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0284efbd524d87abdc189162376e0c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45137 } }
I20260806 11:47:00.404721 1867 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:00.406337 1874 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc0284efbd524d87abdc189162376e0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0284efbd524d87abdc189162376e0c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45137 } } }
I20260806 11:47:00.406543 1874 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:00.407109 1875 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc0284efbd524d87abdc189162376e0c. Latest consensus state: current_term: 1 leader_uuid: "bc0284efbd524d87abdc189162376e0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc0284efbd524d87abdc189162376e0c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45137 } } }
I20260806 11:47:00.407274 1875 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c [sys.catalog]: This master's current role is: LEADER
W20260806 11:47:00.412424 1897 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:47:00.413381 1897 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:47:00.413497 1885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:00.415012 1885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:00.423883 1885 catalog_manager.cc:1347] Generated new cluster ID: fec63eb5c8334674bd112663efb2a297
I20260806 11:47:00.424000 1885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:00.434453 1885 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:00.435788 1885 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:00.441540 1885 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc0284efbd524d87abdc189162376e0c: Generated new TSK 0
I20260806 11:47:00.442456 1885 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 11:47:00.492619 1910 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 11:47:00.492849 1910 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 11:47:00.493265 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:00.464553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57094 (local address 127.26.172.254:45137)
0806 11:47:00.464783 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:00.464789 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:00.465155 (+ 366us) server_negotiation.cc:407] Connection header received
0806 11:47:00.465518 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:00.465522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:00.465594 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:00.465739 (+ 145us) server_negotiation.cc:226] Negotiated authn=JWT
0806 11:47:00.466137 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.466921 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.468485 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.468775 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.468894 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:00.469480 (+ 586us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 11:47:00.492635 (+ 23155us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 11:47:00.493083 (+ 448us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57094: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":97}
W20260806 11:47:00.493374 1871 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57094: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 11:47:00.494930 1909 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:00.464470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:45137 (local address 127.0.0.1:57094)
0806 11:47:00.464979 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:00.465001 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:00.465227 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:00.465786 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:00.465790 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:00.465800 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0806 11:47:00.465963 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:00.465971 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.467076 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.467080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:00.468306 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:00.468319 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.468954 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.468961 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:00.469083 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:00.469177 (+ 94us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 11:47:00.493052 (+ 23875us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 11:47:00.493376 (+ 324us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.172.254:45137: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":200,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.172.254:45137: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 11:47:00.495782 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 1782
2026-08-06T11:47:00Z chronyd exiting
I20260806 11:47:00.542434 27315 test_util.cc:175] -----------------------------------------------
I20260806 11:47:00.542573 27315 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786016786541679-27315-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (468 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 11:47:00.543967 27315 mini_oidc.cc:152] Starting JWKS server
I20260806 11:47:00.544945 27315 webserver.cc:460] Webserver started at https://127.0.0.1:35311/ using document root <none> and password file <none>
I20260806 11:47:00.545094 27315 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 11:47:00.545447 27315 webserver.cc:460] Webserver started at http://127.0.0.1:43809/ using document root <none> and password file <none>
2026-08-06T11:47:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:00Z Disabled control of system clock
I20260806 11:47:00.559285 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:35651
--webserver_interface=127.26.172.254
--webserver_port=0
--builtin_ntp_servers=127.26.172.212:35127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:35651
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35311/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/testchainca.cert with env {}
W20260806 11:47:00.709743 1917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:00.710170 1917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:00.710223 1917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:00.714977 1917 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:00.715095 1917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:00.715111 1917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:00.715130 1917 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:00.715148 1917 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 11:47:00.715169 1917 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 11:47:00.715183 1917 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35311/jwks.json
I20260806 11:47:00.722059 1917 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:35127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:35651
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:35651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35311/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:00.724159 1917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:00.726219 1917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:00.740017 1925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:00.740000 1928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:00.739998 1926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:00.740408 1917 server_base.cc:1034] running on GCE node
I20260806 11:47:00.741231 1917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:00.742641 1917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:00.743988 1917 hybrid_clock.cc:648] HybridClock initialized: now 1786016820743942 us; error 73 us; skew 500 ppm
I20260806 11:47:00.746490 1917 webserver.cc:460] Webserver started at http://127.26.172.254:38585/ using document root <none> and password file <none>
I20260806 11:47:00.747303 1917 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:00.747385 1917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:00.747603 1917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:00.750062 1917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "df9767f783984532bb9ed8e6456a1d13"
format_stamp: "Formatted at 2026-08-06 11:47:00 on dist-test-slave-7z32"
server_key: "1628cc12ddc1f717931a2dd0aabbf957"
server_key_iv: "8ee3aa46ebf4a0f19c1bb19967c67da1"
server_key_version: "encryptionkey@0"
I20260806 11:47:00.750695 1917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "df9767f783984532bb9ed8e6456a1d13"
format_stamp: "Formatted at 2026-08-06 11:47:00 on dist-test-slave-7z32"
server_key: "1628cc12ddc1f717931a2dd0aabbf957"
server_key_iv: "8ee3aa46ebf4a0f19c1bb19967c67da1"
server_key_version: "encryptionkey@0"
I20260806 11:47:00.755731 1917 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.003s
I20260806 11:47:00.759277 1936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:00.761158 1917 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:47:00.761345 1917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "df9767f783984532bb9ed8e6456a1d13"
format_stamp: "Formatted at 2026-08-06 11:47:00 on dist-test-slave-7z32"
server_key: "1628cc12ddc1f717931a2dd0aabbf957"
server_key_iv: "8ee3aa46ebf4a0f19c1bb19967c67da1"
server_key_version: "encryptionkey@0"
I20260806 11:47:00.761477 1917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:00.778331 1917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:00.779244 1917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:00.779452 1917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:00.788465 1917 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:35651
I20260806 11:47:00.788511 1998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:35651 every 8 connection(s)
I20260806 11:47:00.789783 1917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:00.790484 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 1917
I20260806 11:47:00.790648 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:00.791112 27315 external_mini_cluster.cc:1428] Setting key 3c02e638f7ebdd3db93007fa8091d37d
I20260806 11:47:00.794499 1999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:00.802932 1999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13: Bootstrap starting.
I20260806 11:47:00.804814 2005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:00.793361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47230 (local address 127.26.172.254:35651)
0806 11:47:00.794324 (+ 963us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:00.794345 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:00.794393 (+ 48us) server_negotiation.cc:407] Connection header received
0806 11:47:00.795392 (+ 999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:00.795421 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:00.795987 (+ 566us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:00.796413 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:00.796981 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.798405 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.799950 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.800631 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.800809 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:00.802032 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:00.802039 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:00.802061 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:00.802671 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:00.802784 (+ 113us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:00.802812 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:00.802993 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:00.803245 (+ 252us) server_negotiation.cc:299] Negotiation successful
0806 11:47:00.803744 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":231,"threads_started":1}
I20260806 11:47:00.805895 1999 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:00.806955 1999 log.cc:824] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:00.809401 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:47:00.810297 1999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13: No bootstrap required, opened a new log
I20260806 11:47:00.814801 1999 raft_consensus.cc:348] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df9767f783984532bb9ed8e6456a1d13" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35651 } }
I20260806 11:47:00.815229 1999 raft_consensus.cc:374] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:00.815333 1999 raft_consensus.cc:729] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df9767f783984532bb9ed8e6456a1d13, State: Initialized, Role: FOLLOWER
I20260806 11:47:00.815902 1999 consensus_queue.cc:260] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df9767f783984532bb9ed8e6456a1d13" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35651 } }
I20260806 11:47:00.816090 1999 raft_consensus.cc:388] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:00.816198 1999 raft_consensus.cc:482] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:00.816325 1999 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:00.817705 1999 raft_consensus.cc:504] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df9767f783984532bb9ed8e6456a1d13" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35651 } }
I20260806 11:47:00.818185 1999 leader_election.cc:302] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df9767f783984532bb9ed8e6456a1d13; no voters:
I20260806 11:47:00.818622 1999 leader_election.cc:288] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:00.819373 2007 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:00.819983 2007 raft_consensus.cc:686] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [term 1 LEADER]: Becoming Leader. State: Replica: df9767f783984532bb9ed8e6456a1d13, State: Running, Role: LEADER
I20260806 11:47:00.820250 1999 sys_catalog.cc:564] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:00.820765 2007 consensus_queue.cc:237] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df9767f783984532bb9ed8e6456a1d13" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35651 } }
I20260806 11:47:00.823283 2010 sys_catalog.cc:455] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df9767f783984532bb9ed8e6456a1d13. Latest consensus state: current_term: 1 leader_uuid: "df9767f783984532bb9ed8e6456a1d13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df9767f783984532bb9ed8e6456a1d13" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35651 } } }
I20260806 11:47:00.823457 2010 sys_catalog.cc:458] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:00.823385 2009 sys_catalog.cc:455] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df9767f783984532bb9ed8e6456a1d13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df9767f783984532bb9ed8e6456a1d13" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 35651 } } }
I20260806 11:47:00.823554 2009 sys_catalog.cc:458] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13 [sys.catalog]: This master's current role is: LEADER
W20260806 11:47:00.826902 2025 catalog_manager.cc:1558] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:47:00.827023 2025 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:47:00.827101 2026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:00.828246 2026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:00.837513 2026 catalog_manager.cc:1347] Generated new cluster ID: ebc014b5a8d74bb7b08857dd70907427
I20260806 11:47:00.837651 2026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:00.855039 2026 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:00.856755 2026 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:00.864184 2026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df9767f783984532bb9ed8e6456a1d13: Generated new TSK 0
I20260806 11:47:00.865288 2026 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 11:47:00.902055 2046 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 11:47:00.902196 2046 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 11:47:00.903282 2005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:00.877535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47236 (local address 127.26.172.254:35651)
0806 11:47:00.877798 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:00.877806 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:00.878130 (+ 324us) server_negotiation.cc:407] Connection header received
0806 11:47:00.878444 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:00.878448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:00.878516 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:00.878671 (+ 155us) server_negotiation.cc:226] Negotiated authn=JWT
0806 11:47:00.879039 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.879733 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.880809 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.881075 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.881210 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:00.881642 (+ 432us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 11:47:00.902570 (+ 20928us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 11:47:00.903021 (+ 451us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47236: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":122}
W20260806 11:47:00.903401 2005 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47236: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 11:47:00.903442 2044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:00.877400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:35651 (local address 127.0.0.1:47236)
0806 11:47:00.877996 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:00.878012 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:00.878219 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:00.878665 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:00.878668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:00.878678 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0806 11:47:00.878909 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:00.878918 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.879882 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.879886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:00.880669 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:00.880678 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:00.881230 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:00.881234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:00.881349 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:00.881384 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 11:47:00.902941 (+ 21557us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 11:47:00.903212 (+ 271us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.172.254:35651: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":188,"threads_started":1}
I20260806 11:47:00.904422 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 1917
2026-08-06T11:47:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (410 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 11:47:00.954423 27315 mini_oidc.cc:152] Starting JWKS server
I20260806 11:47:00.955471 27315 webserver.cc:460] Webserver started at https://127.0.0.1:39105/ using document root <none> and password file <none>
I20260806 11:47:00.955580 27315 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 11:47:00.955806 27315 webserver.cc:460] Webserver started at http://127.0.0.1:42661/ using document root <none> and password file <none>
2026-08-06T11:47:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:00Z Disabled control of system clock
I20260806 11:47:00.970013 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:38821
--webserver_interface=127.26.172.254
--webserver_port=0
--builtin_ntp_servers=127.26.172.212:44939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:38821
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39105/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 11:47:01.098690 2052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:01.099191 2052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:01.099246 2052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:01.104616 2052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:01.104743 2052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:01.104761 2052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:01.104780 2052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:01.104796 2052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 11:47:01.104815 2052 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 11:47:01.104830 2052 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39105/jwks.json
I20260806 11:47:01.110419 2052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:38821
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:38821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39105/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:01.111891 2052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:01.113608 2052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:01.124516 2059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:01.124488 2058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:01.124488 2062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:01.125036 2052 server_base.cc:1034] running on GCE node
I20260806 11:47:01.125732 2052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:01.127162 2052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:01.128470 2052 hybrid_clock.cc:648] HybridClock initialized: now 1786016821128475 us; error 80 us; skew 500 ppm
I20260806 11:47:01.131297 2052 webserver.cc:460] Webserver started at http://127.26.172.254:38279/ using document root <none> and password file <none>
I20260806 11:47:01.132054 2052 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:01.132166 2052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:01.132477 2052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:01.135116 2052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "9847d1b229184a4995a37bae7672d151"
format_stamp: "Formatted at 2026-08-06 11:47:01 on dist-test-slave-7z32"
server_key: "d96f0d20f936a5e3e234c94fb745dc01"
server_key_iv: "c93243c564566f55a4295bb955df4c3c"
server_key_version: "encryptionkey@0"
I20260806 11:47:01.135824 2052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "9847d1b229184a4995a37bae7672d151"
format_stamp: "Formatted at 2026-08-06 11:47:01 on dist-test-slave-7z32"
server_key: "d96f0d20f936a5e3e234c94fb745dc01"
server_key_iv: "c93243c564566f55a4295bb955df4c3c"
server_key_version: "encryptionkey@0"
I20260806 11:47:01.141240 2052 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:47:01.145305 2069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:01.147295 2052 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:01.147536 2052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "9847d1b229184a4995a37bae7672d151"
format_stamp: "Formatted at 2026-08-06 11:47:01 on dist-test-slave-7z32"
server_key: "d96f0d20f936a5e3e234c94fb745dc01"
server_key_iv: "c93243c564566f55a4295bb955df4c3c"
server_key_version: "encryptionkey@0"
I20260806 11:47:01.147708 2052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:01.162706 2052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:01.163647 2052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:01.163898 2052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:01.173774 2052 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:38821
I20260806 11:47:01.173801 2128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:38821 every 8 connection(s)
I20260806 11:47:01.175174 2052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:01.180517 2129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:01.180917 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 2052
I20260806 11:47:01.181069 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:01.181409 27315 external_mini_cluster.cc:1428] Setting key f345270ad31c8fc9c81ee3659d6ff62b
I20260806 11:47:01.192071 2129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151: Bootstrap starting.
I20260806 11:47:01.196220 2129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:01.197160 2132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:01.183672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38546 (local address 127.26.172.254:38821)
0806 11:47:01.184744 (+ 1072us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:01.184772 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:01.184840 (+ 68us) server_negotiation.cc:407] Connection header received
0806 11:47:01.185860 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:01.185896 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:01.186996 (+ 1100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:01.187610 (+ 614us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:01.188299 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.189979 (+ 1680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.191548 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.192405 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.192682 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:01.194137 (+ 1455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:01.194146 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:01.194170 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:01.194872 (+ 702us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:01.194981 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:01.195016 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:01.195226 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:01.195455 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 11:47:01.195836 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":169,"threads_started":1}
I20260806 11:47:01.197419 2129 log.cc:824] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:01.201108 2129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151: No bootstrap required, opened a new log
I20260806 11:47:01.202033 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:47:01.207276 2129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847d1b229184a4995a37bae7672d151" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38821 } }
I20260806 11:47:01.207746 2129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:01.207867 2129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9847d1b229184a4995a37bae7672d151, State: Initialized, Role: FOLLOWER
I20260806 11:47:01.208518 2129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847d1b229184a4995a37bae7672d151" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38821 } }
I20260806 11:47:01.208732 2129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:01.208853 2129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:01.209025 2129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:01.210574 2129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847d1b229184a4995a37bae7672d151" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38821 } }
I20260806 11:47:01.211228 2129 leader_election.cc:302] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9847d1b229184a4995a37bae7672d151; no voters:
I20260806 11:47:01.211768 2129 leader_election.cc:288] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:01.212046 2138 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:01.212448 2138 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [term 1 LEADER]: Becoming Leader. State: Replica: 9847d1b229184a4995a37bae7672d151, State: Running, Role: LEADER
I20260806 11:47:01.212924 2138 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847d1b229184a4995a37bae7672d151" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38821 } }
I20260806 11:47:01.213850 2129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:01.215332 2142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9847d1b229184a4995a37bae7672d151. Latest consensus state: current_term: 1 leader_uuid: "9847d1b229184a4995a37bae7672d151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847d1b229184a4995a37bae7672d151" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38821 } } }
I20260806 11:47:01.215539 2142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:01.215932 2139 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9847d1b229184a4995a37bae7672d151" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9847d1b229184a4995a37bae7672d151" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38821 } } }
I20260806 11:47:01.216087 2139 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:01.216238 2153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:01.221347 2153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:01.230185 2153 catalog_manager.cc:1347] Generated new cluster ID: c9433d0bf6e04955aa956b8557dbfe90
I20260806 11:47:01.230320 2153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:01.251365 2153 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:01.252617 2153 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:01.264567 2153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9847d1b229184a4995a37bae7672d151: Generated new TSK 0
I20260806 11:47:01.265964 2153 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:47:01.289755 2132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:01.282575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38548 (local address 127.26.172.254:38821)
0806 11:47:01.282788 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:01.282794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:01.282959 (+ 165us) server_negotiation.cc:407] Connection header received
0806 11:47:01.283233 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:01.283239 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:01.283335 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:01.283535 (+ 200us) server_negotiation.cc:226] Negotiated authn=JWT
0806 11:47:01.283833 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.284812 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.285950 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.286357 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.286504 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:01.287012 (+ 508us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 11:47:01.289172 (+ 2160us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39105/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 11:47:01.289542 (+ 370us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38548: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39105/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":89}
W20260806 11:47:01.289872 2132 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38548: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39105/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 11:47:01.291778 2175 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:01.282401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:38821 (local address 127.0.0.1:38548)
0806 11:47:01.282781 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:01.282799 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:01.283001 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:01.283540 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:01.283542 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:01.283551 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0806 11:47:01.283683 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:01.283689 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.285014 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.285017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:01.285751 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:01.285761 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.286572 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.286576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:01.286662 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:01.286696 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 11:47:01.289456 (+ 2760us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39105/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 11:47:01.291511 (+ 2055us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.172.254:38821: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39105/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":1678,"thread_start_us":145,"threads_started":1}
I20260806 11:47:01.292778 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 2052
E20260806 11:47:01.310637 2176 webserver.cc:533] Webserver: sslize failed:
E20260806 11:47:01.310814 2176 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-06T11:47:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (393 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T11:47:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:01Z Disabled control of system clock
I20260806 11:47:01.361861 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:33299
--webserver_interface=127.26.172.254
--webserver_port=0
--builtin_ntp_servers=127.26.172.212:44115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:33299
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/testchainca.cert with env {}
W20260806 11:47:01.485797 2182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:01.486136 2182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:01.486181 2182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:01.492574 2182 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:01.492704 2182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:01.492736 2182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:01.492766 2182 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:01.492791 2182 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 11:47:01.492837 2182 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 11:47:01.492874 2182 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 11:47:01.502768 2182 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:33299
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:33299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:01.504510 2182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:01.506168 2182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:01.519194 2188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:01.519173 2190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:01.519537 2182 server_base.cc:1034] running on GCE node
W20260806 11:47:01.519173 2187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:01.520700 2182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:01.522694 2182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:01.526074 2182 hybrid_clock.cc:648] HybridClock initialized: now 1786016821525961 us; error 82 us; skew 500 ppm
I20260806 11:47:01.529943 2182 webserver.cc:460] Webserver started at http://127.26.172.254:39177/ using document root <none> and password file <none>
I20260806 11:47:01.531318 2182 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:01.531467 2182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:01.531860 2182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:01.536031 2182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "ab1d23fa9a3c43a0be9cd0009afe4908"
format_stamp: "Formatted at 2026-08-06 11:47:01 on dist-test-slave-7z32"
server_key: "e9c200876afd5b96b8928a9b8228f545"
server_key_iv: "604545dae5f56a4a8c822692f8b465e3"
server_key_version: "encryptionkey@0"
I20260806 11:47:01.536993 2182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "ab1d23fa9a3c43a0be9cd0009afe4908"
format_stamp: "Formatted at 2026-08-06 11:47:01 on dist-test-slave-7z32"
server_key: "e9c200876afd5b96b8928a9b8228f545"
server_key_iv: "604545dae5f56a4a8c822692f8b465e3"
server_key_version: "encryptionkey@0"
I20260806 11:47:01.545441 2182 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260806 11:47:01.550109 2197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:01.553026 2182 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:47:01.553386 2182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "ab1d23fa9a3c43a0be9cd0009afe4908"
format_stamp: "Formatted at 2026-08-06 11:47:01 on dist-test-slave-7z32"
server_key: "e9c200876afd5b96b8928a9b8228f545"
server_key_iv: "604545dae5f56a4a8c822692f8b465e3"
server_key_version: "encryptionkey@0"
I20260806 11:47:01.553618 2182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:01.580533 2182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:01.581691 2182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:01.581964 2182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:01.592857 2182 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:33299
I20260806 11:47:01.592976 2264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:33299 every 8 connection(s)
I20260806 11:47:01.594532 2182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:01.598424 2265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:01.602259 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 2182
I20260806 11:47:01.602488 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:01.603009 27315 external_mini_cluster.cc:1428] Setting key c3e82aad40d771bc92b8a0b1a802df6f
I20260806 11:47:01.605551 2265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908: Bootstrap starting.
I20260806 11:47:01.608362 2265 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:01.609449 2265 log.cc:824] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:01.612047 2265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908: No bootstrap required, opened a new log
I20260806 11:47:01.616736 2265 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1d23fa9a3c43a0be9cd0009afe4908" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33299 } }
I20260806 11:47:01.617014 2265 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:01.617051 2265 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab1d23fa9a3c43a0be9cd0009afe4908, State: Initialized, Role: FOLLOWER
I20260806 11:47:01.617385 2268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:01.605234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59408 (local address 127.26.172.254:33299)
0806 11:47:01.606197 (+ 963us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:01.606219 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:01.606267 (+ 48us) server_negotiation.cc:407] Connection header received
0806 11:47:01.607278 (+ 1011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:01.607306 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:01.608211 (+ 905us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:01.608802 (+ 591us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:01.609331 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.610802 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.612348 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.613115 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.613311 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:01.614409 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:01.614416 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:01.614438 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:01.615152 (+ 714us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:01.615248 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:01.615279 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:01.615386 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:01.615687 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 11:47:01.616135 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":252,"threads_started":1}
I20260806 11:47:01.617581 2265 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1d23fa9a3c43a0be9cd0009afe4908" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33299 } }
I20260806 11:47:01.617790 2265 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:01.617873 2265 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:01.617991 2265 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:01.619263 2265 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1d23fa9a3c43a0be9cd0009afe4908" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33299 } }
I20260806 11:47:01.619666 2265 leader_election.cc:302] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab1d23fa9a3c43a0be9cd0009afe4908; no voters:
I20260806 11:47:01.620076 2265 leader_election.cc:288] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:01.620157 2270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:01.620384 2270 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [term 1 LEADER]: Becoming Leader. State: Replica: ab1d23fa9a3c43a0be9cd0009afe4908, State: Running, Role: LEADER
I20260806 11:47:01.620721 2270 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1d23fa9a3c43a0be9cd0009afe4908" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33299 } }
I20260806 11:47:01.621569 2265 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:01.622470 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:47:01.622460 2271 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab1d23fa9a3c43a0be9cd0009afe4908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1d23fa9a3c43a0be9cd0009afe4908" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33299 } } }
I20260806 11:47:01.622635 2271 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:01.623049 2272 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab1d23fa9a3c43a0be9cd0009afe4908. Latest consensus state: current_term: 1 leader_uuid: "ab1d23fa9a3c43a0be9cd0009afe4908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1d23fa9a3c43a0be9cd0009afe4908" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33299 } } }
I20260806 11:47:01.623164 2272 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908 [sys.catalog]: This master's current role is: LEADER
W20260806 11:47:01.628304 2289 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:47:01.628430 2289 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:47:01.628500 2281 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:01.629513 2281 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:01.636601 2281 catalog_manager.cc:1347] Generated new cluster ID: 79a718821df74c3ab9ff55c936e5bdab
I20260806 11:47:01.636708 2281 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:01.651615 2281 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:01.652907 2281 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:01.661105 2281 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab1d23fa9a3c43a0be9cd0009afe4908: Generated new TSK 0
I20260806 11:47:01.662524 2281 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:47:01.763818 2268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:01.679392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59418 (local address 127.26.172.254:33299)
0806 11:47:01.679649 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:01.679656 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:01.679823 (+ 167us) server_negotiation.cc:407] Connection header received
0806 11:47:01.680059 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:01.680062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:01.680124 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:01.680261 (+ 137us) server_negotiation.cc:226] Negotiated authn=JWT
0806 11:47:01.680518 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.681136 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.682064 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.682298 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.682422 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:01.682778 (+ 356us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 11:47:01.763349 (+ 80571us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 11:47:01.763680 (+ 331us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59418: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":67}
W20260806 11:47:01.763937 2268 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59418: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 11:47:01.764382 2300 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:01.679316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33299 (local address 127.0.0.1:59418)
0806 11:47:01.679709 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:01.679722 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:01.679869 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:01.680248 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:01.680251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:01.680260 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0806 11:47:01.680397 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:01.680404 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.681278 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.681282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:01.681933 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:01.681940 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:01.682442 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:01.682446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:01.682547 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:01.682573 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 11:47:01.763696 (+ 81123us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 11:47:01.764061 (+ 365us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.172.254:33299: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":123,"threads_started":1}
I20260806 11:47:01.766083 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 2182
2026-08-06T11:47:01Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (451 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (152 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (152 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:47:02 dist-test-slave-7z32 krb5kdc[2317](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:47:02 dist-test-slave-7z32 krb5kdc[2317](info): set up 2 sockets
Aug 06 11:47:02 dist-test-slave-7z32 krb5kdc[2317](info): commencing operation
krb5kdc: starting...
W20260806 11:47:03.404441 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.300s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:47:03 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016823, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:47:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:47:03.568295 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40477
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:33779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:40477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:03.697916 2335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:03.698274 2335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:03.698323 2335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:03.702701 2335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:03.702807 2335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:03.702896 2335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:03.702931 2335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:03.702950 2335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:03.709017 2335 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:33779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:40477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:03.710319 2335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:03.711611 2335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:03.722375 2344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:03.722375 2346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:03.722364 2343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:03.723044 2335 server_base.cc:1034] running on GCE node
I20260806 11:47:03.724237 2335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:03.726284 2335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:03.727671 2335 hybrid_clock.cc:648] HybridClock initialized: now 1786016823727645 us; error 67 us; skew 500 ppm
Aug 06 11:47:03 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016823, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:03.736392 2335 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:47:03.737601 2335 webserver.cc:460] Webserver started at http://127.26.172.254:39185/ using document root <none> and password file <none>
I20260806 11:47:03.738284 2335 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:03.738368 2335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:03.738574 2335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:03.741247 2335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "258a3f28b8b64e20972b175cb2379d0d"
format_stamp: "Formatted at 2026-08-06 11:47:03 on dist-test-slave-7z32"
server_key: "8483915cb70bdb836c8f00378fe72ff5"
server_key_iv: "60047d803d1457006285640987b81388"
server_key_version: "encryptionkey@0"
I20260806 11:47:03.741866 2335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "258a3f28b8b64e20972b175cb2379d0d"
format_stamp: "Formatted at 2026-08-06 11:47:03 on dist-test-slave-7z32"
server_key: "8483915cb70bdb836c8f00378fe72ff5"
server_key_iv: "60047d803d1457006285640987b81388"
server_key_version: "encryptionkey@0"
I20260806 11:47:03.746606 2335 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 11:47:03.750155 2356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:03.752074 2335 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:47:03.752259 2335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "258a3f28b8b64e20972b175cb2379d0d"
format_stamp: "Formatted at 2026-08-06 11:47:03 on dist-test-slave-7z32"
server_key: "8483915cb70bdb836c8f00378fe72ff5"
server_key_iv: "60047d803d1457006285640987b81388"
server_key_version: "encryptionkey@0"
I20260806 11:47:03.752445 2335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:03.815852 2335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:03.820176 2335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:03.820470 2335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:03.829820 2335 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:40477
I20260806 11:47:03.829864 2421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:40477 every 8 connection(s)
I20260806 11:47:03.831065 2335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:03.835168 2422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:03.840909 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 2335
I20260806 11:47:03.841082 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:03.841445 27315 external_mini_cluster.cc:1428] Setting key aea9bb769d21f1a946a52a1da5cd05df
I20260806 11:47:03.843487 2422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d: Bootstrap starting.
I20260806 11:47:03.846977 2422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:03.848065 2422 log.cc:824] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:03.851701 2422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d: No bootstrap required, opened a new log
Aug 06 11:47:03 dist-test-slave-7z32 krb5kdc[2317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016823, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:47:03.858383 2422 raft_consensus.cc:348] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "258a3f28b8b64e20972b175cb2379d0d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40477 } }
I20260806 11:47:03.858882 2422 raft_consensus.cc:374] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:03.858966 2422 raft_consensus.cc:729] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 258a3f28b8b64e20972b175cb2379d0d, State: Initialized, Role: FOLLOWER
I20260806 11:47:03.859580 2422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "258a3f28b8b64e20972b175cb2379d0d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40477 } }
I20260806 11:47:03.859786 2422 raft_consensus.cc:388] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:03.859889 2422 raft_consensus.cc:482] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:03.860039 2422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:03.861450 2422 raft_consensus.cc:504] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "258a3f28b8b64e20972b175cb2379d0d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40477 } }
I20260806 11:47:03.861938 2422 leader_election.cc:302] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 258a3f28b8b64e20972b175cb2379d0d; no voters:
I20260806 11:47:03.862430 2422 leader_election.cc:288] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:03.862476 2425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:03.843884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56828 (local address 127.26.172.254:40477)
0806 11:47:03.844635 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:03.844658 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:03.844721 (+ 63us) server_negotiation.cc:407] Connection header received
0806 11:47:03.845701 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:03.845724 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:03.846187 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:03.846651 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:03.847714 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:03.848999 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:03.850701 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:03.851379 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:03.851570 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:03.855446 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:03.855455 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:03.855494 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:03.855558 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:03.858276 (+ 2718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:03.859104 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:03.859116 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:03.859126 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:03.859376 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:03.859706 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:03.859710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:03.859711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:03.860429 (+ 718us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:03.860674 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:03.861005 (+ 331us) server_negotiation.cc:299] Negotiation successful
0806 11:47:03.861389 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":236,"threads_started":1}
I20260806 11:47:03.862607 2429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:03.862932 2429 raft_consensus.cc:686] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [term 1 LEADER]: Becoming Leader. State: Replica: 258a3f28b8b64e20972b175cb2379d0d, State: Running, Role: LEADER
I20260806 11:47:03.863334 2429 consensus_queue.cc:237] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "258a3f28b8b64e20972b175cb2379d0d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40477 } }
I20260806 11:47:03.864323 2422 sys_catalog.cc:564] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:03.864847 2432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 258a3f28b8b64e20972b175cb2379d0d. Latest consensus state: current_term: 1 leader_uuid: "258a3f28b8b64e20972b175cb2379d0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "258a3f28b8b64e20972b175cb2379d0d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40477 } } }
I20260806 11:47:03.864998 2432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:03.865734 2430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "258a3f28b8b64e20972b175cb2379d0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "258a3f28b8b64e20972b175cb2379d0d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40477 } } }
I20260806 11:47:03.865862 2430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:03.866384 2434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:03.869436 2434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:03.877169 2434 catalog_manager.cc:1347] Generated new cluster ID: 40b6f9f736574a1293c9a8cafd1b3f63
I20260806 11:47:03.877280 2434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:03.896924 2434 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:03.898770 2434 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:03.909977 2434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 258a3f28b8b64e20972b175cb2379d0d: Generated new TSK 0
I20260806 11:47:03.911173 2434 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:47:03.964238 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40477
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:33779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:04.097754 2458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:04.098089 2458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:04.098137 2458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:04.102537 2458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:04.102629 2458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:04.102691 2458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:47:04.109105 2458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:33779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:04.110455 2458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:04.111681 2458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:04.123450 2464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:04.123405 2463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:04.123519 2468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:04.123975 2458 server_base.cc:1034] running on GCE node
I20260806 11:47:04.124534 2458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:04.125324 2458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:04.126636 2458 hybrid_clock.cc:648] HybridClock initialized: now 1786016824126590 us; error 61 us; skew 500 ppm
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:04.130460 2458 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:47:04.131875 2458 webserver.cc:460] Webserver started at http://127.26.172.193:36075/ using document root <none> and password file <none>
I20260806 11:47:04.132576 2458 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:04.132687 2458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:04.132979 2458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:04.135533 2458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "e18d03049e6a4e51bc950f2a05300133"
format_stamp: "Formatted at 2026-08-06 11:47:04 on dist-test-slave-7z32"
server_key: "c9d7557f4f6d270c94c4fb07b9763b19"
server_key_iv: "e753e2343a1eee47e06369917cd63276"
server_key_version: "encryptionkey@0"
I20260806 11:47:04.136217 2458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "e18d03049e6a4e51bc950f2a05300133"
format_stamp: "Formatted at 2026-08-06 11:47:04 on dist-test-slave-7z32"
server_key: "c9d7557f4f6d270c94c4fb07b9763b19"
server_key_iv: "e753e2343a1eee47e06369917cd63276"
server_key_version: "encryptionkey@0"
I20260806 11:47:04.141436 2458 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:47:04.145221 2481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:04.147089 2458 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:04.147296 2458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "e18d03049e6a4e51bc950f2a05300133"
format_stamp: "Formatted at 2026-08-06 11:47:04 on dist-test-slave-7z32"
server_key: "c9d7557f4f6d270c94c4fb07b9763b19"
server_key_iv: "e753e2343a1eee47e06369917cd63276"
server_key_version: "encryptionkey@0"
I20260806 11:47:04.147476 2458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:04.164654 2458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:04.169159 2458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:04.169504 2458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:04.170259 2458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:04.171391 2458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:04.171473 2458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:04.171557 2458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:04.171605 2458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:04.183996 2458 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:41643
I20260806 11:47:04.184016 2626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:41643 every 8 connection(s)
I20260806 11:47:04.185057 2458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:47:04.186002 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 2458
I20260806 11:47:04.186156 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:47:04.186573 27315 external_mini_cluster.cc:1428] Setting key e3fd7f5565470d26beeed12d935c1133
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:47:04.207938 2425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:04.188556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:52371 (local address 127.26.172.254:40477)
0806 11:47:04.188864 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:04.188871 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:04.190067 (+ 1196us) server_negotiation.cc:407] Connection header received
0806 11:47:04.191971 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:04.191979 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:04.192098 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:04.192275 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:04.194432 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.195243 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.197415 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.197786 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.197932 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:04.202170 (+ 4238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:04.202174 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:04.202177 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:04.202216 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:04.204068 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.205108 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.205119 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.205121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.205328 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.206117 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.206121 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.206123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.206465 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:04.206588 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:04.207612 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0806 11:47:04.207775 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
I20260806 11:47:04.209411 2630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:04.189177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40477 (local address 127.26.172.193:52371)
0806 11:47:04.189822 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:04.189902 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:04.191639 (+ 1737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:04.192594 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:04.192607 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:04.193289 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:04.194161 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:04.194190 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.195433 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.195439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:04.197164 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:04.197185 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.198035 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.198041 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:04.198357 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:04.199377 (+ 1020us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:04.199403 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:04.201870 (+ 2467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:04.204342 (+ 2472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:04.204353 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:04.204379 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:04.204908 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:04.205465 (+ 557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:04.205469 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:04.205471 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:04.205933 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:04.206624 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:04.206634 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:04.207236 (+ 602us) client_negotiation.cc:769] Sending connection context
0806 11:47:04.207538 (+ 302us) client_negotiation.cc:240] Negotiation successful
0806 11:47:04.208102 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":202,"threads_started":1}
I20260806 11:47:04.211548 2627 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40477
I20260806 11:47:04.212049 2627 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:04.212929 2627 heartbeater.cc:511] Master 127.26.172.254:40477 requested a full tablet report, sending...
I20260806 11:47:04.215514 2376 ts_manager.cc:194] Registered new tserver with Master: e18d03049e6a4e51bc950f2a05300133 (127.26.172.193:41643)
I20260806 11:47:04.217027 2376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:52371
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:47:04.231959 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40477
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:33779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:04.360133 2633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:04.360548 2633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:04.360595 2633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:04.365473 2633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:04.365585 2633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:04.365724 2633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:47:04.371785 2633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:33779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:04.373095 2633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:04.374271 2633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:04.386032 2642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:04.386227 2633 server_base.cc:1034] running on GCE node
W20260806 11:47:04.386009 2639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:04.386508 2640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:04.387138 2633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:04.388012 2633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:04.389226 2633 hybrid_clock.cc:648] HybridClock initialized: now 1786016824389201 us; error 54 us; skew 500 ppm
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:04.393149 2633 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:47:04.394452 2633 webserver.cc:460] Webserver started at http://127.26.172.194:36403/ using document root <none> and password file <none>
I20260806 11:47:04.395191 2633 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:04.395298 2633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:04.395576 2633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:04.397912 2633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "afad25cf0884438187305620872760da"
format_stamp: "Formatted at 2026-08-06 11:47:04 on dist-test-slave-7z32"
server_key: "978a5386f9f6d07ae4866491743b8274"
server_key_iv: "b8fd3a344d6816cfccf89ef1e2c09694"
server_key_version: "encryptionkey@0"
I20260806 11:47:04.398562 2633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "afad25cf0884438187305620872760da"
format_stamp: "Formatted at 2026-08-06 11:47:04 on dist-test-slave-7z32"
server_key: "978a5386f9f6d07ae4866491743b8274"
server_key_iv: "b8fd3a344d6816cfccf89ef1e2c09694"
server_key_version: "encryptionkey@0"
I20260806 11:47:04.403601 2633 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:47:04.407227 2651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:04.409312 2633 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:47:04.409579 2633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "afad25cf0884438187305620872760da"
format_stamp: "Formatted at 2026-08-06 11:47:04 on dist-test-slave-7z32"
server_key: "978a5386f9f6d07ae4866491743b8274"
server_key_iv: "b8fd3a344d6816cfccf89ef1e2c09694"
server_key_version: "encryptionkey@0"
I20260806 11:47:04.409785 2633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:04.442476 2633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:04.447330 2633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:04.447641 2633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:04.448532 2633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:04.449769 2633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:04.449857 2633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:04.449951 2633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:04.450012 2633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:04.463780 2633 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:43893
I20260806 11:47:04.463910 2787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:43893 every 8 connection(s)
I20260806 11:47:04.465327 2633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:47:04.474387 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 2633
I20260806 11:47:04.474581 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:47:04.475095 27315 external_mini_cluster.cc:1428] Setting key bda079acd3dcfa50ceac4ebb5e11a85e
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:47:04.485373 2425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:04.468309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:49047 (local address 127.26.172.254:40477)
0806 11:47:04.468545 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:04.468551 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:04.469496 (+ 945us) server_negotiation.cc:407] Connection header received
0806 11:47:04.471555 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:04.471559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:04.471624 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:04.471735 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:04.473512 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.474090 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.476126 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.476442 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.476634 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:04.480616 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:04.480620 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:04.480622 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:04.480654 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:04.482893 (+ 2239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.483569 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.483574 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.483576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.483667 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.484071 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.484075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.484076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.484294 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:04.484415 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:04.485032 (+ 617us) server_negotiation.cc:299] Negotiation successful
0806 11:47:04.485182 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260806 11:47:04.486500 2791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:04.468518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40477 (local address 127.26.172.194:49047)
0806 11:47:04.469257 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:04.469329 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:04.471245 (+ 1916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:04.471986 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:04.471996 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:04.472521 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:04.473299 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:04.473318 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.474290 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.474295 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:04.475896 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:04.475941 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.476738 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.476748 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:04.477090 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:04.477943 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:04.477964 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:04.480335 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:04.483070 (+ 2735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:04.483079 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:04.483107 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:04.483435 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:04.483771 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:04.483774 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:04.483776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:04.483956 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:04.484415 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:04.484424 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:04.484742 (+ 318us) client_negotiation.cc:769] Sending connection context
0806 11:47:04.484974 (+ 232us) client_negotiation.cc:240] Negotiation successful
0806 11:47:04.485371 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":184,"threads_started":1}
I20260806 11:47:04.488359 2789 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40477
I20260806 11:47:04.488677 2789 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:04.489300 2789 heartbeater.cc:511] Master 127.26.172.254:40477 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:47:04.490815 2376 ts_manager.cc:194] Registered new tserver with Master: afad25cf0884438187305620872760da (127.26.172.194:43893)
I20260806 11:47:04.491564 2376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:49047
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:47:04.515884 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40477
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:33779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:04.670228 2795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:04.670650 2795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:04.670703 2795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:04.675352 2795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:04.675446 2795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:04.675518 2795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:47:04.681828 2795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:33779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40477
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:04.683876 2795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:04.685511 2795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:04.698964 2801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:04.698964 2804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:04.698989 2800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:04.699528 2795 server_base.cc:1034] running on GCE node
I20260806 11:47:04.700090 2795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:04.700896 2795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:04.702165 2795 hybrid_clock.cc:648] HybridClock initialized: now 1786016824702136 us; error 59 us; skew 500 ppm
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:04.705916 2795 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:47:04.707417 2795 webserver.cc:460] Webserver started at http://127.26.172.195:41219/ using document root <none> and password file <none>
I20260806 11:47:04.708156 2795 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:04.708268 2795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:04.708572 2795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:04.711434 2795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "6e65502393bf4bfd8ee361c45c02c0a5"
format_stamp: "Formatted at 2026-08-06 11:47:04 on dist-test-slave-7z32"
server_key: "b0cb7a8f11f2c031f733bce571d5d2f5"
server_key_iv: "672a564e4e73c5f6ec7bf5acec718fdc"
server_key_version: "encryptionkey@0"
I20260806 11:47:04.712182 2795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "6e65502393bf4bfd8ee361c45c02c0a5"
format_stamp: "Formatted at 2026-08-06 11:47:04 on dist-test-slave-7z32"
server_key: "b0cb7a8f11f2c031f733bce571d5d2f5"
server_key_iv: "672a564e4e73c5f6ec7bf5acec718fdc"
server_key_version: "encryptionkey@0"
I20260806 11:47:04.717722 2795 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:47:04.721886 2813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:04.724167 2795 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:04.724401 2795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "6e65502393bf4bfd8ee361c45c02c0a5"
format_stamp: "Formatted at 2026-08-06 11:47:04 on dist-test-slave-7z32"
server_key: "b0cb7a8f11f2c031f733bce571d5d2f5"
server_key_iv: "672a564e4e73c5f6ec7bf5acec718fdc"
server_key_version: "encryptionkey@0"
I20260806 11:47:04.724635 2795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:04.737195 2795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:04.741125 2795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:04.741441 2795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:04.742172 2795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:04.743319 2795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:04.743400 2795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:04.743482 2795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:04.743528 2795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:04.755568 2795 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:43673
I20260806 11:47:04.755741 2967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:43673 every 8 connection(s)
I20260806 11:47:04.756899 2795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:47:04.757467 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 2795
I20260806 11:47:04.757637 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:47:04.758108 27315 external_mini_cluster.cc:1428] Setting key 9ae150a53bd8ea1bdd1996cf5bfff8df
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:47:04.778219 2425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:04.760497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:56731 (local address 127.26.172.254:40477)
0806 11:47:04.760687 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:04.760692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:04.762045 (+ 1353us) server_negotiation.cc:407] Connection header received
0806 11:47:04.763847 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:04.763851 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:04.763923 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:04.764025 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:04.765831 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.766536 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.768248 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.768619 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.768760 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:04.772364 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:04.772369 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:04.772372 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:04.772421 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:04.775168 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.775916 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.775919 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.775921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.776043 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.776598 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.776601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.776602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.776864 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:04.776965 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:04.777873 (+ 908us) server_negotiation.cc:299] Negotiation successful
0806 11:47:04.778043 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 11:47:04.779143 2972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:04.761180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40477 (local address 127.26.172.195:56731)
0806 11:47:04.761821 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:04.761879 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:04.763561 (+ 1682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:04.764314 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:04.764323 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:04.764846 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:04.765574 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:04.765597 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.766923 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.766929 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:04.768043 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:04.768056 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.768819 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.768822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:04.769011 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:04.769795 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:04.769815 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:04.772033 (+ 2218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:04.775335 (+ 3302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:04.775342 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:04.775370 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:04.775746 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:04.776200 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:04.776203 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:04.776205 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:04.776470 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:04.777019 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:04.777027 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:04.777368 (+ 341us) client_negotiation.cc:769] Sending connection context
0806 11:47:04.777577 (+ 209us) client_negotiation.cc:240] Negotiation successful
0806 11:47:04.777924 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":196,"threads_started":1}
I20260806 11:47:04.781162 2968 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40477
I20260806 11:47:04.781584 2968 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:04.782490 2968 heartbeater.cc:511] Master 127.26.172.254:40477 requested a full tablet report, sending...
I20260806 11:47:04.784247 2376 ts_manager.cc:194] Registered new tserver with Master: 6e65502393bf4bfd8ee361c45c02c0a5 (127.26.172.195:43673)
I20260806 11:47:04.785168 2376 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:56731
I20260806 11:47:04.787745 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/test-admin.keytab.
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:04.813812 27315 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 11:47:04.818048 2977 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:04.815937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48302 (local address 127.26.172.193:41643)
0806 11:47:04.816411 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:04.816421 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:04.816457 (+ 36us) server_negotiation.cc:407] Connection header received
0806 11:47:04.816537 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:04.816544 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:04.816864 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:04.817051 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:04.817780 (+ 729us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48302: BlockingRecv error: recv got EOF from 127.0.0.1:48302 (error 108)
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":158,"threads_started":1}
W20260806 11:47:04.818323 27315 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5cc' of type FILE
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:04.819983 27315 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:04.821525 27315 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:47:04.837268 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:04.823238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48310 (local address 127.26.172.193:41643)
0806 11:47:04.823424 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:04.823428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:04.823450 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:47:04.823523 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:04.823526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:04.823591 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:04.823715 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:04.824633 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.826058 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.827348 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.827983 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.828156 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:04.832207 (+ 4051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:04.832226 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:04.832247 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:04.832293 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:04.834665 (+ 2372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.835428 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.835437 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.835438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.835549 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.835916 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.835925 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.835926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.836297 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:04.836598 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:04.836829 (+ 231us) server_negotiation.cc:299] Negotiation successful
0806 11:47:04.837044 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260806 11:47:04.843564 2977 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:04.842124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48320 (local address 127.26.172.193:41643)
0806 11:47:04.842306 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:04.842311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:04.842416 (+ 105us) server_negotiation.cc:407] Connection header received
0806 11:47:04.842560 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:04.842564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:04.842636 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:04.842759 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:04.843407 (+ 648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48320: BlockingRecv error: recv got EOF from 127.0.0.1:48320 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 11:47:04.843973 27315 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5cc)
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:04.845335 27315 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:04.846575 27315 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:47:04.861549 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:04.848617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48322 (local address 127.26.172.193:41643)
0806 11:47:04.848901 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:04.848908 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:04.849058 (+ 150us) server_negotiation.cc:407] Connection header received
0806 11:47:04.849343 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:04.849347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:04.849409 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:04.849512 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:04.851044 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.851715 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.852963 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.853227 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.853363 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:04.856955 (+ 3592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:04.856959 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:04.856961 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:04.857000 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:04.859198 (+ 2198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.859978 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.859982 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.859983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.860088 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.860482 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.860485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.860486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.860715 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:04.860876 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:04.861229 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 11:47:04.861409 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
W20260806 11:47:04.866408 2977 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:04.864676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48334 (local address 127.26.172.193:41643)
0806 11:47:04.864849 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:04.864862 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:04.865052 (+ 190us) server_negotiation.cc:407] Connection header received
0806 11:47:04.865249 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:04.865252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:04.865309 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:04.865396 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:04.866235 (+ 839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48334: BlockingRecv error: recv got EOF from 127.0.0.1:48334 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260806 11:47:04.866593 27315 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786016786541679-27315-0/krb5kdc/krb5cc' of type FILE
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:04.867969 27315 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:04.869072 27315 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 11:47:04 dist-test-slave-7z32 krb5kdc[2317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:47:04.881040 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:04.870333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48350 (local address 127.26.172.193:41643)
0806 11:47:04.870509 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:04.870517 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:04.870620 (+ 103us) server_negotiation.cc:407] Connection header received
0806 11:47:04.870809 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:04.870813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:04.870925 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:04.871026 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:04.871605 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.872137 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.872990 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:04.873219 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:04.873335 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:04.876680 (+ 3345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:04.876684 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:04.876687 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:04.876717 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:04.878501 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.879477 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.879480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.879482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.879582 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:04.879987 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:04.879990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:04.879991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:04.880196 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:04.880421 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:04.880766 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 11:47:04.880892 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 11:47:04.882907 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 2458
I20260806 11:47:04.902624 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 2633
I20260806 11:47:04.918889 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 2795
I20260806 11:47:04.935875 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 2335
2026-08-06T11:47:04Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2870 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:47:05 dist-test-slave-7z32 krb5kdc[2992](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:47:05 dist-test-slave-7z32 krb5kdc[2992](info): set up 2 sockets
Aug 06 11:47:05 dist-test-slave-7z32 krb5kdc[2992](info): commencing operation
krb5kdc: starting...
W20260806 11:47:06.278051 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:47:06 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:47:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:06Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.254.keytab.
Entry for principal oryx/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.254.keytab.
I20260806 11:47:06.451694 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:43861
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.254.keytab
--principal=oryx/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:43861
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:06.609932 3014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:06.610388 3014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:06.610438 3014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:06.615648 3014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:06.615789 3014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:06.615813 3014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:06.615832 3014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:06.615850 3014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:06.622762 3014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:43861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.254.keytab
--principal=oryx/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:43861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:06.624467 3014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:06.625924 3014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:06.637622 3020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:06.637614 3023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:06.637622 3021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:06.637971 3014 server_base.cc:1034] running on GCE node
I20260806 11:47:06.639115 3014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:06.640630 3014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:06.641848 3014 hybrid_clock.cc:648] HybridClock initialized: now 1786016826641801 us; error 71 us; skew 500 ppm
Aug 06 11:47:06 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016826, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:06.646057 3014 init.cc:377] Logged in from keytab as oryx/127.26.172.254@KRBTEST.COM (short username oryx)
I20260806 11:47:06.647807 3014 webserver.cc:460] Webserver started at http://127.26.172.254:44181/ using document root <none> and password file <none>
I20260806 11:47:06.648708 3014 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:06.648839 3014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:06.649187 3014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:06.652539 3014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "c964b9ce3b3c4819b7094acd447672f0"
format_stamp: "Formatted at 2026-08-06 11:47:06 on dist-test-slave-7z32"
server_key: "1e2a41dda152bb95faf270425cc3e670"
server_key_iv: "cee532ef8e7c8e7462ecd8a4bc60544f"
server_key_version: "encryptionkey@0"
I20260806 11:47:06.653443 3014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "c964b9ce3b3c4819b7094acd447672f0"
format_stamp: "Formatted at 2026-08-06 11:47:06 on dist-test-slave-7z32"
server_key: "1e2a41dda152bb95faf270425cc3e670"
server_key_iv: "cee532ef8e7c8e7462ecd8a4bc60544f"
server_key_version: "encryptionkey@0"
I20260806 11:47:06.660785 3014 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260806 11:47:06.664881 3034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:06.667253 3014 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:06.667531 3014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "c964b9ce3b3c4819b7094acd447672f0"
format_stamp: "Formatted at 2026-08-06 11:47:06 on dist-test-slave-7z32"
server_key: "1e2a41dda152bb95faf270425cc3e670"
server_key_iv: "cee532ef8e7c8e7462ecd8a4bc60544f"
server_key_version: "encryptionkey@0"
I20260806 11:47:06.667735 3014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:06.696941 3014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:06.701740 3014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:06.702066 3014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:06.713034 3014 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:43861
I20260806 11:47:06.713538 3097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:43861 every 8 connection(s)
I20260806 11:47:06.714545 3014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:06.718253 3098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:06.724100 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 3014
I20260806 11:47:06.724275 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:06.724608 27315 external_mini_cluster.cc:1428] Setting key 34006bf78b7891bfd0d85a6876e9cc5a
I20260806 11:47:06.725229 3098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0: Bootstrap starting.
I20260806 11:47:06.728338 3098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:06.729254 3098 log.cc:824] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:06.732072 3098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0: No bootstrap required, opened a new log
Aug 06 11:47:06 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:06.737462 3098 raft_consensus.cc:348] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } }
I20260806 11:47:06.737833 3098 raft_consensus.cc:374] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:06.737931 3098 raft_consensus.cc:729] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c964b9ce3b3c4819b7094acd447672f0, State: Initialized, Role: FOLLOWER
I20260806 11:47:06.738598 3098 consensus_queue.cc:260] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } }
I20260806 11:47:06.738845 3098 raft_consensus.cc:388] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:06.738951 3098 raft_consensus.cc:482] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:06.739084 3098 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:06.740469 3098 raft_consensus.cc:504] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } }
I20260806 11:47:06.740965 3098 leader_election.cc:302] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c964b9ce3b3c4819b7094acd447672f0; no voters:
I20260806 11:47:06.741427 3098 leader_election.cc:288] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:06.741515 3106 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:06.741818 3106 raft_consensus.cc:686] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 1 LEADER]: Becoming Leader. State: Replica: c964b9ce3b3c4819b7094acd447672f0, State: Running, Role: LEADER
I20260806 11:47:06.742213 3106 consensus_queue.cc:237] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } }
I20260806 11:47:06.743224 3098 sys_catalog.cc:564] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:06.744318 3108 sys_catalog.cc:455] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } }
I20260806 11:47:06.744516 3108 sys_catalog.cc:458] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:06.744966 3109 sys_catalog.cc:455] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c964b9ce3b3c4819b7094acd447672f0. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } }
I20260806 11:47:06.745150 3109 sys_catalog.cc:458] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:06.745586 3119 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:06.746349 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:06.726617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57698 (local address 127.26.172.254:43861)
0806 11:47:06.727366 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:06.727391 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:06.727449 (+ 58us) server_negotiation.cc:407] Connection header received
0806 11:47:06.728541 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:06.728578 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:06.729095 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:06.729591 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:06.730581 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:06.731917 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:06.733182 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:06.733792 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:06.733945 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:06.737948 (+ 4003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:06.737957 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:06.737989 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:06.738043 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:06.740781 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:06.741525 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:06.741534 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:06.741545 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:06.741854 (+ 309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:06.742255 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:06.742259 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:06.742261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:06.742994 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:06.743252 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:06.744071 (+ 819us) server_negotiation.cc:299] Negotiation successful
0806 11:47:06.744503 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":225,"threads_started":1}
I20260806 11:47:06.751783 3119 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:06.760852 3119 catalog_manager.cc:1347] Generated new cluster ID: 209097add5a84419abc13b8342ac1d7c
I20260806 11:47:06.760970 3119 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:06.784957 3119 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:06.786193 3119 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:06.795727 3119 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0: Generated new TSK 0
I20260806 11:47:06.797123 3119 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab.
Entry for principal oryx/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab.
I20260806 11:47:06.840591 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:43861
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab
--principal=oryx/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:06.976960 3134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:06.977306 3134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:06.977361 3134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:06.981880 3134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:06.981971 3134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:06.982035 3134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:47:06.987846 3134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab
--principal=oryx/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:43861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:06.989316 3134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:06.990571 3134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:07.002547 3140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:07.002544 3143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:07.002718 3141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:07.003129 3134 server_base.cc:1034] running on GCE node
I20260806 11:47:07.003654 3134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:07.004534 3134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:07.005722 3134 hybrid_clock.cc:648] HybridClock initialized: now 1786016827005696 us; error 48 us; skew 500 ppm
Aug 06 11:47:07 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016827, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:07.009392 3134 init.cc:377] Logged in from keytab as oryx/127.26.172.193@KRBTEST.COM (short username oryx)
I20260806 11:47:07.010530 3134 webserver.cc:460] Webserver started at http://127.26.172.193:33397/ using document root <none> and password file <none>
I20260806 11:47:07.011467 3134 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:07.011584 3134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:07.011914 3134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:07.014497 3134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "5e03c88772984603871093691a7dcfb7"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "06136e99397a718c805b4a5b5583896e"
server_key_iv: "d1072b46cd995c638c8460249d808a0c"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.015228 3134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "5e03c88772984603871093691a7dcfb7"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "06136e99397a718c805b4a5b5583896e"
server_key_iv: "d1072b46cd995c638c8460249d808a0c"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.020133 3134 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:47:07.023562 3152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:07.025290 3134 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 11:47:07.025524 3134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "5e03c88772984603871093691a7dcfb7"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "06136e99397a718c805b4a5b5583896e"
server_key_iv: "d1072b46cd995c638c8460249d808a0c"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.025672 3134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:07.050395 3134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:07.054692 3134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:07.055032 3134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:07.055753 3134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:07.056861 3134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:07.056927 3134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:07.056977 3134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:07.056995 3134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:07.070027 3134 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:41227
I20260806 11:47:07.070088 3295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:41227 every 8 connection(s)
I20260806 11:47:07.071432 3134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:47:07.081439 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 3134
I20260806 11:47:07.081593 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:47:07.081985 27315 external_mini_cluster.cc:1428] Setting key 2c3944b313505ba6aa7160717fa9a344
Aug 06 11:47:07 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016827, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:07.094976 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:07.074519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:57471 (local address 127.26.172.254:43861)
0806 11:47:07.074742 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:07.074748 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:07.076114 (+ 1366us) server_negotiation.cc:407] Connection header received
0806 11:47:07.078213 (+ 2099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:07.078218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:07.078325 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:07.078455 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:07.080586 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.081282 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.083119 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.083489 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.083622 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:07.088652 (+ 5030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:07.088657 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:07.088660 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:07.088701 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:07.091148 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:07.092348 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:07.092356 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:07.092359 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:07.092507 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:07.093141 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:07.093147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:07.093151 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:07.093539 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:07.093683 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:07.094521 (+ 838us) server_negotiation.cc:299] Negotiation successful
0806 11:47:07.094718 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 11:47:07.096349 3298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:07.075131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.193:57471)
0806 11:47:07.075862 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:07.075935 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:07.077855 (+ 1920us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:07.078735 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:07.078745 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:07.079410 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:07.080302 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:07.080330 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.081468 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.081472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:07.082949 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:07.082966 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.083822 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.083828 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:07.084215 (+ 387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:07.085100 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:07.085129 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:07.088071 (+ 2942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:07.091451 (+ 3380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:07.091464 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:07.091491 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:07.092133 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:07.092712 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:07.092716 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:07.092717 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:07.092964 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:07.093694 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:07.093703 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:07.094131 (+ 428us) client_negotiation.cc:769] Sending connection context
0806 11:47:07.094391 (+ 260us) client_negotiation.cc:240] Negotiation successful
0806 11:47:07.094929 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":152,"threads_started":1}
WARNING: no policy specified for oryx/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:47:07.098536 3296 heartbeater.cc:347] Connected to a master server at 127.26.172.254:43861
I20260806 11:47:07.099004 3296 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.194@KRBTEST.COM" created.
I20260806 11:47:07.100306 3296 heartbeater.cc:511] Master 127.26.172.254:43861 requested a full tablet report, sending...
I20260806 11:47:07.103425 3054 ts_manager.cc:194] Registered new tserver with Master: 5e03c88772984603871093691a7dcfb7 (127.26.172.193:41227)
I20260806 11:47:07.105199 3054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:57471
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab.
Entry for principal oryx/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab.
I20260806 11:47:07.124111 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:43861
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab
--principal=oryx/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:07.258610 3301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:07.259063 3301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:07.259123 3301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:07.264173 3301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:07.264262 3301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:07.264338 3301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:47:07.270890 3301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab
--principal=oryx/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:43861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:07.272258 3301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:07.273674 3301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:07.286792 3311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:07.286792 3308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:07.286777 3307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:07.287288 3301 server_base.cc:1034] running on GCE node
I20260806 11:47:07.288398 3301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:07.289408 3301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:07.292904 3301 hybrid_clock.cc:648] HybridClock initialized: now 1786016827292814 us; error 93 us; skew 500 ppm
Aug 06 11:47:07 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016827, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:07.297811 3301 init.cc:377] Logged in from keytab as oryx/127.26.172.194@KRBTEST.COM (short username oryx)
I20260806 11:47:07.299559 3301 webserver.cc:460] Webserver started at http://127.26.172.194:42991/ using document root <none> and password file <none>
I20260806 11:47:07.300432 3301 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:07.300565 3301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:07.300891 3301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:07.304018 3301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "f09eefa997904f9ca9192c8deaa28ce2"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "b75a1b0bd5bb2cb1d1c56b9aebc78cc3"
server_key_iv: "1e3db0423c4aa6cd745cb5c633d09747"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.304853 3301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "f09eefa997904f9ca9192c8deaa28ce2"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "b75a1b0bd5bb2cb1d1c56b9aebc78cc3"
server_key_iv: "1e3db0423c4aa6cd745cb5c633d09747"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.310695 3301 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:47:07.314675 3319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:07.316751 3301 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:47:07.317013 3301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "f09eefa997904f9ca9192c8deaa28ce2"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "b75a1b0bd5bb2cb1d1c56b9aebc78cc3"
server_key_iv: "1e3db0423c4aa6cd745cb5c633d09747"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.317219 3301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:07.334949 3301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:07.339727 3301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:07.340022 3301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:07.340910 3301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:07.342167 3301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:07.342253 3301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:07.342338 3301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:07.342386 3301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:07.355926 3301 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:34161
I20260806 11:47:07.355950 3476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:34161 every 8 connection(s)
I20260806 11:47:07.357390 3301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:47:07.365861 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 3301
I20260806 11:47:07.366027 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:47:07.366405 27315 external_mini_cluster.cc:1428] Setting key 9d703121ff91069bfbef41b0c1eda6e9
Aug 06 11:47:07 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016827, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:07.378738 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:07.360327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:45673 (local address 127.26.172.254:43861)
0806 11:47:07.360529 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:07.360534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:07.361907 (+ 1373us) server_negotiation.cc:407] Connection header received
0806 11:47:07.364089 (+ 2182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:07.364093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:07.364183 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:07.364303 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:07.366316 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.367152 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.368925 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.369405 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.369569 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:07.372938 (+ 3369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:07.372945 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:07.372949 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:07.373004 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:07.375395 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:07.376332 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:07.376337 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:07.376340 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:07.376490 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:07.377030 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:07.377043 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:07.377044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:07.377351 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:07.377457 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:07.378397 (+ 940us) server_negotiation.cc:299] Negotiation successful
0806 11:47:07.378571 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 11:47:07.380205 3482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:07.360955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.194:45673)
0806 11:47:07.361669 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:07.361734 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:07.363734 (+ 2000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:07.364622 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:07.364632 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:07.365156 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:07.366029 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:07.366059 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.367429 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.367433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:07.368732 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:07.368746 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.369634 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.369638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:07.369837 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:07.370670 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:07.370690 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:07.372650 (+ 1960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:07.375576 (+ 2926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:07.375588 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:07.375612 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:07.376145 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:07.376626 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:07.376631 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:07.376635 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:07.376869 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:07.377501 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:07.377512 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:07.377986 (+ 474us) client_negotiation.cc:769] Sending connection context
0806 11:47:07.378348 (+ 362us) client_negotiation.cc:240] Negotiation successful
0806 11:47:07.378844 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":169,"threads_started":1}
WARNING: no policy specified for oryx/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:47:07.382299 3480 heartbeater.cc:347] Connected to a master server at 127.26.172.254:43861
I20260806 11:47:07.382756 3480 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:07.383508 3480 heartbeater.cc:511] Master 127.26.172.254:43861 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.195@KRBTEST.COM" created.
I20260806 11:47:07.385277 3054 ts_manager.cc:194] Registered new tserver with Master: f09eefa997904f9ca9192c8deaa28ce2 (127.26.172.194:34161)
I20260806 11:47:07.386098 3054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:45673
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab.
Entry for principal oryx/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab.
I20260806 11:47:07.407631 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:43861
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab
--principal=oryx/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:07.573432 3485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:07.573853 3485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:07.573907 3485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:07.579046 3485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:07.579159 3485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:07.579236 3485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:47:07.586249 3485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab
--principal=oryx/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:43861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:07.588006 3485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:07.589488 3485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:07.603209 3494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:07.603324 3497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:07.603314 3485 server_base.cc:1034] running on GCE node
W20260806 11:47:07.603209 3491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:07.604317 3485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:07.605259 3485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:07.606509 3485 hybrid_clock.cc:648] HybridClock initialized: now 1786016827606491 us; error 36 us; skew 500 ppm
Aug 06 11:47:07 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016827, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:07.610584 3485 init.cc:377] Logged in from keytab as oryx/127.26.172.195@KRBTEST.COM (short username oryx)
I20260806 11:47:07.612437 3485 webserver.cc:460] Webserver started at http://127.26.172.195:42229/ using document root <none> and password file <none>
I20260806 11:47:07.613402 3485 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:07.613528 3485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:07.613844 3485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:07.616926 3485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "0b4ad9e1f159423bb287646159adc19a"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "f820523b4adb28153d5c735811e2b3fd"
server_key_iv: "94926d46ef6a38468d6f2fd03dd3bf43"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.617781 3485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "0b4ad9e1f159423bb287646159adc19a"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "f820523b4adb28153d5c735811e2b3fd"
server_key_iv: "94926d46ef6a38468d6f2fd03dd3bf43"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.624032 3485 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 11:47:07.628144 3508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:07.630417 3485 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:47:07.630648 3485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "0b4ad9e1f159423bb287646159adc19a"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "f820523b4adb28153d5c735811e2b3fd"
server_key_iv: "94926d46ef6a38468d6f2fd03dd3bf43"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.630827 3485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:07.652216 3485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:07.657236 3485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:07.657459 3485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:07.658300 3485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:07.659497 3485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:07.659576 3485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:07.659659 3485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:07.659703 3485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:07.673238 3485 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:45327
I20260806 11:47:07.673238 3661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:45327 every 8 connection(s)
I20260806 11:47:07.674624 3485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:47:07.680938 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 3485
I20260806 11:47:07.681145 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:47:07.681537 27315 external_mini_cluster.cc:1428] Setting key d20a781160f1023f177659723bc899d7
Aug 06 11:47:07 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016827, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:07.692790 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:07.677360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:55043 (local address 127.26.172.254:43861)
0806 11:47:07.677574 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:07.677579 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:07.679002 (+ 1423us) server_negotiation.cc:407] Connection header received
0806 11:47:07.680810 (+ 1808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:07.680814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:07.680890 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:07.681018 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:07.682771 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.683471 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.685013 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.685274 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.685412 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:07.688536 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:07.688540 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:07.688542 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:07.688572 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:07.690312 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:07.691055 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:07.691058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:07.691059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:07.691142 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:07.691526 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:07.691529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:07.691531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:07.691742 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:07.691859 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:07.692446 (+ 587us) server_negotiation.cc:299] Negotiation successful
0806 11:47:07.692591 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260806 11:47:07.694082 3665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:07.677958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.195:55043)
0806 11:47:07.678701 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:07.678764 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:07.680525 (+ 1761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:07.681288 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:07.681300 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:07.681859 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:07.682573 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:07.682600 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.683626 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.683631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:07.684850 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:07.684862 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:07.685471 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:07.685476 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:07.685684 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:07.686437 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:07.686457 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:07.688310 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:07.690517 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:07.690525 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:07.690546 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:07.690917 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:07.691243 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:07.691246 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:07.691248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:07.691413 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:07.691865 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:07.691875 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:07.692170 (+ 295us) client_negotiation.cc:769] Sending connection context
0806 11:47:07.692382 (+ 212us) client_negotiation.cc:240] Negotiation successful
0806 11:47:07.692768 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":219,"threads_started":1}
I20260806 11:47:07.696065 3662 heartbeater.cc:347] Connected to a master server at 127.26.172.254:43861
I20260806 11:47:07.696511 3662 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:07.697350 3662 heartbeater.cc:511] Master 127.26.172.254:43861 requested a full tablet report, sending...
I20260806 11:47:07.698994 3054 ts_manager.cc:194] Registered new tserver with Master: 0b4ad9e1f159423bb287646159adc19a (127.26.172.195:45327)
I20260806 11:47:07.699739 3054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:55043
I20260806 11:47:07.711576 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.172.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.253.keytab.
Entry for principal oryx/127.26.172.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.253.keytab.
I20260806 11:47:07.751420 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.253:39155
--webserver_interface=127.26.172.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.253.keytab
--principal=oryx/127.26.172.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:43861,127.26.172.253:39155
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:07.899274 3668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:07.899693 3668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:07.899777 3668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:07.904590 3668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:07.904696 3668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:07.904717 3668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:07.904736 3668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:07.904753 3668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:07.912184 3668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:43861,127.26.172.253:39155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.253.keytab
--principal=oryx/127.26.172.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.253:39155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.172.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
W20260806 11:47:07.912596 3668 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.172.254:43861,127.26.172.253:39155'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 11:47:07.914038 3668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:07.915627 3668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:07.927708 3674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:07.927652 3673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:07.927661 3676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:07.928419 3668 server_base.cc:1034] running on GCE node
I20260806 11:47:07.929208 3668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:07.930773 3668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:07.934145 3668 hybrid_clock.cc:648] HybridClock initialized: now 1786016827934086 us; error 78 us; skew 500 ppm
Aug 06 11:47:07 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016827, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:07.938444 3668 init.cc:377] Logged in from keytab as oryx/127.26.172.253@KRBTEST.COM (short username oryx)
I20260806 11:47:07.939831 3668 webserver.cc:460] Webserver started at http://127.26.172.253:42701/ using document root <none> and password file <none>
I20260806 11:47:07.940593 3668 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:07.940670 3668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:07.940904 3668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:07.943933 3668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data/instance:
uuid: "f98f52fcd6164bca9e52b20f50e562da"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "aa33d8e8947c7bc85507952f9a6dd95f"
server_key_iv: "38345a88c8ae34f23035fa89e90286c3"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.944859 3668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal/instance:
uuid: "f98f52fcd6164bca9e52b20f50e562da"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "aa33d8e8947c7bc85507952f9a6dd95f"
server_key_iv: "38345a88c8ae34f23035fa89e90286c3"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.950634 3668 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:47:07.955063 3684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:07.957697 3668 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:47:07.957995 3668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal
uuid: "f98f52fcd6164bca9e52b20f50e562da"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "aa33d8e8947c7bc85507952f9a6dd95f"
server_key_iv: "38345a88c8ae34f23035fa89e90286c3"
server_key_version: "encryptionkey@0"
I20260806 11:47:07.958206 3668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:07.979590 3668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:07.984982 3668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:07.985337 3668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:07.996438 3668 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.253:39155
I20260806 11:47:07.996532 3758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.253:39155 every 8 connection(s)
I20260806 11:47:07.997943 3668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
I20260806 11:47:08.001780 3764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:08.003311 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 3668
I20260806 11:47:08.007792 3764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016827, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.253@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.172.253@KRBTEST.COM
I20260806 11:47:08.023734 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.010218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57708 (local address 127.26.172.254:43861)
0806 11:47:08.010407 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.010411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.010762 (+ 351us) server_negotiation.cc:407] Connection header received
0806 11:47:08.010972 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.010976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.011049 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.011165 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.012129 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.012685 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.013846 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.014081 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.014205 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.017718 (+ 3513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.017726 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.017731 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.017788 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.020150 (+ 2362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.020969 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.020974 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.020976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.021142 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.021751 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.021754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.021756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.022245 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.022356 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.023296 (+ 940us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.023495 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 11:47:08.025224 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.005468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51616 (local address 127.26.172.253:39155)
0806 11:47:08.006251 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.006279 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.006345 (+ 66us) server_negotiation.cc:407] Connection header received
0806 11:47:08.007457 (+ 1112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.007491 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.008139 (+ 648us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.008744 (+ 605us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.009923 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.011845 (+ 1922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.013181 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.013977 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.014264 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.018340 (+ 4076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.018350 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.018368 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.018474 (+ 106us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.020745 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.021585 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.021596 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.021602 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.021715 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.022273 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.022277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.022278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.022807 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.023138 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.023509 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.023715 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":521,"thread_start_us":201,"threads_started":1}
I20260806 11:47:08.025224 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.010081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:57708)
0806 11:47:08.010584 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.010642 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.010849 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.011240 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.011245 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.011656 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.011949 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.011958 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.012839 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.012843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.013693 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.013704 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.014319 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.014325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.014581 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.015337 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.015357 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.017425 (+ 2068us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.020329 (+ 2904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.020350 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.020410 (+ 60us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.020818 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.021299 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.021302 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.021304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.021549 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.022394 (+ 845us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.022403 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.022852 (+ 449us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.023222 (+ 370us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.023664 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":171,"thread_start_us":164,"threads_started":1}
I20260806 11:47:08.028388 3764 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016827, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.253@KRBTEST.COM for oryx/127.26.172.253@KRBTEST.COM
I20260806 11:47:08.038689 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.029466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51624 (local address 127.26.172.253:39155)
0806 11:47:08.029614 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.029618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.029628 (+ 10us) server_negotiation.cc:407] Connection header received
0806 11:47:08.029656 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.029658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.029690 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.029782 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.030724 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.031431 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.032217 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.032464 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.032584 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.035242 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.035246 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.035249 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.035272 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.036881 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.037317 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.037322 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.037324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.037485 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.037788 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.037796 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.037797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.037986 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.038092 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.038363 (+ 271us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.038531 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":71}
I20260806 11:47:08.038689 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.029184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:39155 (local address 127.0.0.1:51624)
0806 11:47:08.029336 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.029354 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.029470 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.029792 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.029795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.030060 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.030593 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.030601 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.031540 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.031546 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.032091 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.032098 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.032593 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.032596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.032711 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.033259 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.033276 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.035062 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.037001 (+ 1939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.037007 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.037009 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.037214 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.037593 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.037596 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.037598 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.037685 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.038091 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.038094 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.038185 (+ 91us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.038316 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.038478 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":1}
I20260806 11:47:08.042336 3764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: Bootstrap starting.
I20260806 11:47:08.045588 3764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:08.046494 3764 log.cc:824] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:08.049505 3764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: No bootstrap required, opened a new log
I20260806 11:47:08.052975 3764 raft_consensus.cc:348] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } }
I20260806 11:47:08.053295 3764 raft_consensus.cc:374] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:08.053337 3764 raft_consensus.cc:729] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98f52fcd6164bca9e52b20f50e562da, State: Initialized, Role: FOLLOWER
I20260806 11:47:08.053874 3764 consensus_queue.cc:260] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } }
I20260806 11:47:08.054651 3773 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } } }
I20260806 11:47:08.055035 3773 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:47:08.055505 3764 sys_catalog.cc:564] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: configured and running, proceeding with master startup.
W20260806 11:47:08.062501 3785 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:47:08.062707 3785 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:47:08.064719 3668 master_runner.cc:428] Detected that this master f98f52fcd6164bca9e52b20f50e562da is joining an existing cluster
I20260806 11:47:08.064832 3668 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.172.253:39155
I20260806 11:47:08.079475 3794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.068308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:39155 (local address 127.0.0.1:51626)
0806 11:47:08.068808 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.068828 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.068980 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.069336 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.069338 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.069667 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.069859 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.069869 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.070917 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.070919 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.071868 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.071890 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.072574 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.072577 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.072676 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.074422 (+ 1746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.074441 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.075238 (+ 797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.077618 (+ 2380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.077623 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.077625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.077971 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.078279 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.078285 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.078287 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.078387 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.078811 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.078814 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.078936 (+ 122us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.079065 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.079234 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":1,"thread_start_us":276,"threads_started":1}
I20260806 11:47:08.079838 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.068317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51626 (local address 127.26.172.253:39155)
0806 11:47:08.068441 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.068448 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.068915 (+ 467us) server_negotiation.cc:407] Connection header received
0806 11:47:08.069082 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.069086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.069123 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.069176 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.070001 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.070732 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.072012 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.072309 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.072396 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.075413 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.075417 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.075420 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.075441 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.077479 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.078082 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.078087 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.078089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.078172 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.078483 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.078489 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.078491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.078703 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.078861 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.079548 (+ 687us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.079676 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 11:47:08.081334 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.068037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57716 (local address 127.26.172.254:43861)
0806 11:47:08.068489 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.068496 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.068843 (+ 347us) server_negotiation.cc:407] Connection header received
0806 11:47:08.069015 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.069022 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.069090 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.069183 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.070047 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.071176 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.072737 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.073125 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.073226 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.075213 (+ 1987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.075218 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.075221 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.075261 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.077370 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.078124 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.078128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.078130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.078248 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.078606 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.078609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.078611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.078960 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.079101 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.080926 (+ 1825us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.081137 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311}
I20260806 11:47:08.082216 3792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.067901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:57716)
0806 11:47:08.068700 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.068719 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.068898 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.069245 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.069249 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.069611 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.069857 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.069867 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.071367 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.071371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.072537 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.072552 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.073474 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.073477 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.073601 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.074166 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.074191 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.074982 (+ 791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.077537 (+ 2555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.077541 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.077543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.077965 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.078393 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.078396 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.078398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.078496 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.079180 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.079183 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.079293 (+ 110us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.081795 (+ 2502us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.082002 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"mutex_wait_us":52,"thread_start_us":163,"threads_started":1}
WARNING: no policy specified for oryx/127.26.172.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.252@KRBTEST.COM" created.
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016826, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.254@KRBTEST.COM for oryx/127.26.172.253@KRBTEST.COM
I20260806 11:47:08.105937 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.091612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51628 (local address 127.26.172.253:39155)
0806 11:47:08.091775 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.091782 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.091818 (+ 36us) server_negotiation.cc:407] Connection header received
0806 11:47:08.092042 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.092049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.092142 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.092295 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.093518 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.094424 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.095920 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.096316 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.096457 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.100790 (+ 4333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.100798 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.100804 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.100858 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.103006 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.103960 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.103968 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.103972 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.104094 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.104492 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.104498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.104502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.104807 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.104926 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.105520 (+ 594us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.105699 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 11:47:08.105945 3797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.090312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:39155 (local address 127.0.0.1:51628)
0806 11:47:08.091109 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.091196 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.091415 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.092383 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.092393 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.093084 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.093300 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.093311 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.094666 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.094672 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.095719 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.095737 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.096577 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.096583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.096800 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.097934 (+ 1134us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.097954 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.100455 (+ 2501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.103237 (+ 2782us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.103256 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.103269 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.103777 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.104220 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.104223 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.104226 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.104346 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.104947 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.104958 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.105185 (+ 227us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.105377 (+ 192us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.105695 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":244,"threads_started":1}
I20260806 11:47:08.109328 3054 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.172.253:39155: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da"
member_type: NON_VOTER
last_known_addr {
host: "127.26.172.253"
port: 39155
}
attrs {
promote: true
}
}
dest_uuid: "c964b9ce3b3c4819b7094acd447672f0"
cas_config_opid_index: -1
I20260806 11:47:08.109825 3296 heartbeater.cc:503] Master 127.26.172.254:43861 was elected leader, sending a full tablet report...
I20260806 11:47:08.110697 3054 consensus_queue.cc:237] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } }
I20260806 11:47:08.113631 3807 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER f98f52fcd6164bca9e52b20f50e562da (127.26.172.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } } }
I20260806 11:47:08.116045 3718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:08.116493 3807 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.172.253:39155
I20260806 11:47:08.117815 3668 master.cc:537] Master@127.26.172.253:39155 shutting down...
I20260806 11:47:08.118110 3718 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 FOLLOWER]: Refusing update from remote peer c964b9ce3b3c4819b7094acd447672f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 11:47:08.116937 3808 sys_catalog.cc:455] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } } }
I20260806 11:47:08.118453 3808 sys_catalog.cc:458] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:08.119306 3808 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 11:47:08.123534 3038 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260806 11:47:08.125105 3038 consensus_peers.cc:487] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 -> Peer f98f52fcd6164bca9e52b20f50e562da (127.26.172.253:39155): Couldn't send request to peer f98f52fcd6164bca9e52b20f50e562da. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 11:47:08.125149 3668 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:08.125499 3668 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:08.125679 3668 tablet_replica.cc:330] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.252.keytab.
Entry for principal oryx/127.26.172.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.252.keytab.
I20260806 11:47:08.127496 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.252:36449
--webserver_interface=127.26.172.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.252.keytab
--principal=oryx/127.26.172.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:43861,127.26.172.253:39155,127.26.172.252:36449
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:47:08.133500 3668 master.cc:552] Master@127.26.172.253:39155 shutdown complete.
I20260806 11:47:08.133592 3668 master_runner.cc:305] Clearing existing system tablet
I20260806 11:47:08.133898 3668 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:08.133977 3668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:08.136152 3668 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260806 11:47:08.137624 3816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:08.138080 3668 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:08.138299 3668 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260806 11:47:08.138362 3668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal
uuid: "f98f52fcd6164bca9e52b20f50e562da"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "aa33d8e8947c7bc85507952f9a6dd95f"
server_key_iv: "38345a88c8ae34f23035fa89e90286c3"
server_key_version: "encryptionkey@0"
I20260806 11:47:08.142181 3668 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:08.146560 3668 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 11:47:08.146737 3668 log.cc:1196] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 11:47:08.147167 3668 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: Deleting consensus metadata
I20260806 11:47:08.147411 3668 master_runner.cc:315] Copying system tablet from 127.26.172.254:43861
I20260806 11:47:08.149134 3668 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: tablet copy: Beginning tablet copy session from remote peer at address 127.26.172.254:43861
I20260806 11:47:08.162446 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.150243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57718 (local address 127.26.172.254:43861)
0806 11:47:08.150436 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.150442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.150778 (+ 336us) server_negotiation.cc:407] Connection header received
0806 11:47:08.151137 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.151142 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.151348 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.151448 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.152487 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.153394 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.154736 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.155165 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.155262 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.157437 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.157442 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.157445 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.157483 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.159609 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.160518 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.160523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.160526 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.160730 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.161195 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.161199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.161201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.161511 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.161649 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.162043 (+ 394us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.162223 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 11:47:08.162475 3824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.149999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:57718)
0806 11:47:08.150630 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.150650 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.150970 (+ 320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.151803 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.151807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.152139 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.152298 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.152307 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.153561 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.153564 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.154560 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.154579 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.155655 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.155662 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.155759 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.156597 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.156616 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.157208 (+ 592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.159812 (+ 2604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.159818 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.159822 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.160244 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.160894 (+ 650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.160897 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.160900 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.161053 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.161647 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.161650 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.161809 (+ 159us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.161953 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.162182 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":119,"threads_started":1}
I20260806 11:47:08.163957 3074 tablet_copy_service.cc:140] P c964b9ce3b3c4819b7094acd447672f0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer f98f52fcd6164bca9e52b20f50e562da ({username='oryx', principal='oryx/127.26.172.253@KRBTEST.COM'} at 127.0.0.1:57718)
I20260806 11:47:08.164225 3074 tablet_copy_service.cc:161] P c964b9ce3b3c4819b7094acd447672f0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer f98f52fcd6164bca9e52b20f50e562da at {username='oryx', principal='oryx/127.26.172.253@KRBTEST.COM'} at 127.0.0.1:57718: session id = f98f52fcd6164bca9e52b20f50e562da-00000000000000000000000000000000
I20260806 11:47:08.166538 3074 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 11:47:08.169471 3668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 11:47:08.173568 3668 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: tablet copy: Starting download of 0 data blocks...
I20260806 11:47:08.173892 3668 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: tablet copy: Starting download of 1 WAL segments...
I20260806 11:47:08.177297 3668 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 11:47:08.180536 3074 tablet_copy_service.cc:342] P c964b9ce3b3c4819b7094acd447672f0: Request end of tablet copy session f98f52fcd6164bca9e52b20f50e562da-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.172.253@KRBTEST.COM'} at 127.0.0.1:57718
I20260806 11:47:08.180770 3074 tablet_copy_service.cc:433] P c964b9ce3b3c4819b7094acd447672f0: ending tablet copy session f98f52fcd6164bca9e52b20f50e562da-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer f98f52fcd6164bca9e52b20f50e562da
I20260806 11:47:08.192965 3668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:08.195643 3827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:08.200321 3829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:08.200974 3668 server_base.cc:1034] running on GCE node
W20260806 11:47:08.201228 3831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:08.201624 3668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:08.202179 3668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:08.203392 3668 hybrid_clock.cc:648] HybridClock initialized: now 1786016828203363 us; error 56 us; skew 500 ppm
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016828, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:08.205869 3668 init.cc:377] Logged in from keytab as oryx/127.26.172.253@KRBTEST.COM (short username oryx)
I20260806 11:47:08.206894 3668 webserver.cc:460] Webserver started at http://127.26.172.253:39677/ using document root <none> and password file <none>
I20260806 11:47:08.207226 3668 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:08.207350 3668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:08.209333 3668 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 11:47:08.210992 3845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:08.211418 3668 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 11:47:08.211512 3668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal
uuid: "f98f52fcd6164bca9e52b20f50e562da"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "aa33d8e8947c7bc85507952f9a6dd95f"
server_key_iv: "38345a88c8ae34f23035fa89e90286c3"
server_key_version: "encryptionkey@0"
I20260806 11:47:08.211615 3668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:08.231765 3668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:08.234723 3668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:08.242854 3668 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.253:39155
I20260806 11:47:08.243057 3920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.253:39155 every 8 connection(s)
I20260806 11:47:08.243923 3668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
I20260806 11:47:08.247000 3922 sys_catalog.cc:263] Verifying existing consensus state
I20260806 11:47:08.248641 3922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: Bootstrap starting.
I20260806 11:47:08.262122 3922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:47:08.262516 3922 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: Bootstrap complete.
I20260806 11:47:08.263290 3922 raft_consensus.cc:348] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } }
I20260806 11:47:08.263450 3922 raft_consensus.cc:729] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f98f52fcd6164bca9e52b20f50e562da, State: Initialized, Role: LEARNER
I20260806 11:47:08.263577 3922 consensus_queue.cc:260] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } }
I20260806 11:47:08.264154 3922 sys_catalog.cc:564] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:08.264146 3925 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } } }
I20260806 11:47:08.264586 3925 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: This master's current role is: LEARNER
I20260806 11:47:08.270601 3950 catalog_manager.cc:1259] Loaded cluster ID: 209097add5a84419abc13b8342ac1d7c
I20260806 11:47:08.270725 3950 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: loading cluster ID for follower catalog manager: success
I20260806 11:47:08.273625 3950 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: acquiring CA information for follower catalog manager: success
I20260806 11:47:08.275532 3950 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 11:47:08.292086 3813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:08.292464 3813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:08.292559 3813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:08.296830 3813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:08.296944 3813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:08.296981 3813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:08.297025 3813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:08.297066 3813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:08.303277 3813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:43861,127.26.172.253:39155,127.26.172.252:36449
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.252.keytab
--principal=oryx/127.26.172.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.252:36449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.172.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:08.304945 3813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:08.306258 3813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:08.317662 3960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:08.317742 3955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:08.317662 3957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:08.318015 3813 server_base.cc:1034] running on GCE node
I20260806 11:47:08.319110 3813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:08.320756 3813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:08.321995 3813 hybrid_clock.cc:648] HybridClock initialized: now 1786016828321966 us; error 76 us; skew 500 ppm
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016828, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:08.326121 3813 init.cc:377] Logged in from keytab as oryx/127.26.172.252@KRBTEST.COM (short username oryx)
I20260806 11:47:08.327612 3813 webserver.cc:460] Webserver started at http://127.26.172.252:38323/ using document root <none> and password file <none>
I20260806 11:47:08.328411 3813 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:08.328495 3813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:08.328738 3813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:08.331864 3813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data/instance:
uuid: "b898a5bd1948400f9a2398176403abfa"
format_stamp: "Formatted at 2026-08-06 11:47:08 on dist-test-slave-7z32"
server_key: "49e6369efeb094740a5746e72431da40"
server_key_iv: "facd71481bce3a20c13e8f690a9fa0f6"
server_key_version: "encryptionkey@0"
I20260806 11:47:08.332626 3813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal/instance:
uuid: "b898a5bd1948400f9a2398176403abfa"
format_stamp: "Formatted at 2026-08-06 11:47:08 on dist-test-slave-7z32"
server_key: "49e6369efeb094740a5746e72431da40"
server_key_iv: "facd71481bce3a20c13e8f690a9fa0f6"
server_key_version: "encryptionkey@0"
I20260806 11:47:08.338724 3813 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260806 11:47:08.342509 3968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:08.344772 3813 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260806 11:47:08.344990 3813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal
uuid: "b898a5bd1948400f9a2398176403abfa"
format_stamp: "Formatted at 2026-08-06 11:47:08 on dist-test-slave-7z32"
server_key: "49e6369efeb094740a5746e72431da40"
server_key_iv: "facd71481bce3a20c13e8f690a9fa0f6"
server_key_version: "encryptionkey@0"
I20260806 11:47:08.345165 3813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:08.386711 3813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:08.389075 3480 heartbeater.cc:503] Master 127.26.172.254:43861 was elected leader, sending a full tablet report...
I20260806 11:47:08.391610 3813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:08.391825 3813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:08.401728 3813 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.252:36449
I20260806 11:47:08.402070 4040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.252:36449 every 8 connection(s)
I20260806 11:47:08.403266 3813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
I20260806 11:47:08.406739 4041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:08.411057 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 3813
I20260806 11:47:08.413957 4041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016828, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.252@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.172.252@KRBTEST.COM
I20260806 11:47:08.441186 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.423236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57732 (local address 127.26.172.254:43861)
0806 11:47:08.423464 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.423471 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.425961 (+ 2490us) server_negotiation.cc:407] Connection header received
0806 11:47:08.426677 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.426681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.426765 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.426940 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.428577 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.429214 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.431013 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.431439 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.431580 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.435527 (+ 3947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.435532 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.435535 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.435578 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.437901 (+ 2323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.438727 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.438731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.438733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.438930 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.439451 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.439455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.439457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.439855 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.439985 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.440748 (+ 763us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.440945 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 11:47:08.442099 4044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.423829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:57732)
0806 11:47:08.425736 (+ 1907us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.425807 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.426374 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.427248 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.427259 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.427913 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.428391 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.428411 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.429369 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.429375 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.430771 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.430785 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.431682 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.431686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.431990 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.432883 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.432912 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.435181 (+ 2269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.438054 (+ 2873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.438063 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.438074 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.438544 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.439079 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.439081 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.439083 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.439314 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.440023 (+ 709us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.440030 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.440351 (+ 321us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.440609 (+ 258us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.441050 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1630,"mutex_wait_us":39,"spinlock_wait_cycles":149376,"thread_start_us":205,"threads_started":1}
I20260806 11:47:08.442689 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.423828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60744 (local address 127.26.172.252:36449)
0806 11:47:08.424606 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.424631 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.425097 (+ 466us) server_negotiation.cc:407] Connection header received
0806 11:47:08.426374 (+ 1277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.426407 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.426720 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.427075 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.428363 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.429667 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.431026 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.431734 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.431939 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.435837 (+ 3898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.435844 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.435858 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.435880 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.438403 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.439066 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.439077 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.439079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.439317 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.439685 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.439688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.439690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.440330 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.440536 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.440855 (+ 319us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.442556 (+ 1701us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1556,"server-negotiator.queue_time_us":561,"spinlock_wait_cycles":27520,"thread_start_us":288,"threads_started":1}
I20260806 11:47:08.444093 4041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016828, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.252@KRBTEST.COM for oryx/127.26.172.253@KRBTEST.COM
I20260806 11:47:08.455015 4044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.444768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:39155 (local address 127.0.0.1:51630)
0806 11:47:08.445031 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.445050 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.445149 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.445462 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.445465 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.445699 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.445891 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.445898 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.447055 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.447061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.447648 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.447657 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.448228 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.448232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.448353 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.448908 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.448921 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.450930 (+ 2009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.453055 (+ 2125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.453059 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.453060 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.453320 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.453709 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.453713 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.453714 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.453800 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.454400 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.454404 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.454525 (+ 121us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.454640 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.454787 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157}
I20260806 11:47:08.455188 4048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.444894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51630 (local address 127.26.172.253:39155)
0806 11:47:08.445188 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.445192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.445210 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:47:08.445252 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.445254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.445295 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.445384 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.446068 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.446907 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.447795 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.448087 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.448215 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.451193 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.451198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.451201 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.451241 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.452884 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.453447 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.453451 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.453452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.453605 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.453935 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.453938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.453939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.454286 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.454380 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.454736 (+ 356us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.454977 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":124,"threads_started":1}
I20260806 11:47:08.456230 4041 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016828, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.252@KRBTEST.COM for oryx/127.26.172.252@KRBTEST.COM
I20260806 11:47:08.466682 4044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.457001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36449 (local address 127.0.0.1:60760)
0806 11:47:08.457201 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.457221 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.457348 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.457645 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.457648 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.457831 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.457930 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.457935 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.458727 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.458731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.459297 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.459306 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.459791 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.459795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.459881 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.460445 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.460463 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.462138 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.464558 (+ 2420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.464561 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.464563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.464909 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.465246 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.465249 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.465250 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.465511 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.466052 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.466055 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.466153 (+ 98us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.466293 (+ 140us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.466470 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260806 11:47:08.466715 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.457047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60760 (local address 127.26.172.252:36449)
0806 11:47:08.457201 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.457207 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.457294 (+ 87us) server_negotiation.cc:407] Connection header received
0806 11:47:08.457508 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.457510 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.457547 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.457633 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.458051 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.458599 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.459436 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.459675 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.459787 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.462365 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.462369 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.462372 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.462409 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.464406 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.465039 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.465042 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.465044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.465143 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.465658 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.465663 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.465666 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.465928 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.466053 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.466353 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.466585 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":86}
I20260806 11:47:08.471427 4041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Bootstrap starting.
I20260806 11:47:08.474241 4041 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:08.475167 4041 log.cc:824] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:08.477787 4041 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: No bootstrap required, opened a new log
I20260806 11:47:08.481094 4041 raft_consensus.cc:348] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } }
I20260806 11:47:08.481526 4041 raft_consensus.cc:374] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:08.481601 4041 raft_consensus.cc:729] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b898a5bd1948400f9a2398176403abfa, State: Initialized, Role: FOLLOWER
I20260806 11:47:08.482035 4041 consensus_queue.cc:260] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } }
I20260806 11:47:08.482754 4050 sys_catalog.cc:455] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } } }
I20260806 11:47:08.483049 4050 sys_catalog.cc:458] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:47:08.483512 4041 sys_catalog.cc:564] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: configured and running, proceeding with master startup.
W20260806 11:47:08.490228 4065 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:47:08.490398 4065 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:47:08.493901 3813 master_runner.cc:428] Detected that this master b898a5bd1948400f9a2398176403abfa is joining an existing cluster
I20260806 11:47:08.494011 3813 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.172.252:36449
I20260806 11:47:08.501063 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 3134
I20260806 11:47:08.513669 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.497355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60770 (local address 127.26.172.252:36449)
0806 11:47:08.497485 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.497490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.504171 (+ 6681us) server_negotiation.cc:407] Connection header received
0806 11:47:08.504324 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.504330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.504393 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.504440 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.505478 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.506228 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.507283 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.507607 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.507674 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.509256 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.509262 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.509267 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.509289 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.511273 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.511989 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.511995 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.512000 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.512122 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.512600 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.512606 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.512610 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.512883 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.512956 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.513285 (+ 329us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.513417 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 11:47:08.514233 4074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.497343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36449 (local address 127.0.0.1:60770)
0806 11:47:08.504073 (+ 6730us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.504092 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.504237 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.504581 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.504586 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.504812 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.505343 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.505361 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.506359 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.506362 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.507170 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.507182 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.507851 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.507855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.507955 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.508569 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.508587 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.509131 (+ 544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.511462 (+ 2331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.511468 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.511473 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.511867 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.512291 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.512297 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.512302 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.512425 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.513041 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.513046 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.513134 (+ 88us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.513834 (+ 700us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.513990 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3929,"mutex_wait_us":5,"thread_start_us":2174,"threads_started":1}
I20260806 11:47:08.533931 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.496491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57736 (local address 127.26.172.254:43861)
0806 11:47:08.496655 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.496661 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.499151 (+ 2490us) server_negotiation.cc:407] Connection header received
0806 11:47:08.499631 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.499634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.499695 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.499755 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.500560 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.501428 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.507497 (+ 6069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.507840 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.507954 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.528974 (+ 21020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.528979 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.528982 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.529025 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.531424 (+ 2399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.532194 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.532198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.532200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.532311 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.532628 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.532632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.532634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.532929 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.533032 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.533549 (+ 517us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.533717 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 11:47:08.534314 4071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.496767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:57736)
0806 11:47:08.499058 (+ 2291us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.499074 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.499509 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.499898 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.499900 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.500247 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.500388 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.500396 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.505431 (+ 5035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.505436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.507350 (+ 1914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.507359 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.508086 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.508091 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.508213 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.527896 (+ 19683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.527915 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.528691 (+ 776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.531616 (+ 2925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.531621 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.531623 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.532041 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.532419 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.532423 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.532425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.532520 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.533093 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.533097 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.533237 (+ 140us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.533337 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.534083 (+ 746us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2191,"mutex_wait_us":1465,"spinlock_wait_cycles":1792,"thread_start_us":151,"threads_started":1}
I20260806 11:47:08.534653 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:41227
--local_ip_for_outbound_sockets=127.26.172.193
--tserver_master_addrs=127.26.172.254:43861
--webserver_port=33397
--webserver_interface=127.26.172.193
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab
--principal=oryx/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.172.254:43861,127.26.172.253:39155
--tserver_master_addrs=127.26.172.254:43861,127.26.172.253:39155,127.26.172.252:36449 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:47:08.535611 4073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.496767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:39155 (local address 127.0.0.1:51644)
0806 11:47:08.499290 (+ 2523us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.499302 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.499406 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.500613 (+ 1207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.500616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.500854 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.500985 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.500993 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.524748 (+ 23755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.524756 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.525860 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.525881 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.526930 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.526938 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.527090 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.527728 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.527750 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.528572 (+ 822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.531537 (+ 2965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.531544 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.531549 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.531990 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.532364 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.532370 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.532375 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.532486 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.533060 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.533067 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.533226 (+ 159us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.533377 (+ 151us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.533632 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2459,"mutex_wait_us":29,"thread_start_us":120,"threads_started":1}
I20260806 11:47:08.536705 4048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.496597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51644 (local address 127.26.172.253:39155)
0806 11:47:08.496837 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.496843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.500098 (+ 3255us) server_negotiation.cc:407] Connection header received
0806 11:47:08.500191 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.500195 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.500272 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.500402 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.522688 (+ 22286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.523910 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.526159 (+ 2249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.526615 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.526802 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.528819 (+ 2017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.528827 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.528834 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.528876 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.531341 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.532134 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.532141 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.532145 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.532243 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.532600 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.532606 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.532610 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.532899 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.533003 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.536248 (+ 3245us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.536453 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016826, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.254@KRBTEST.COM for oryx/127.26.172.252@KRBTEST.COM
I20260806 11:47:08.549759 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.540089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55114 (local address 127.26.172.252:36449)
0806 11:47:08.540209 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.540213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.540374 (+ 161us) server_negotiation.cc:407] Connection header received
0806 11:47:08.540702 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.540705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.540764 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.540926 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.541517 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.542027 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.543079 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.543296 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.543414 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.546136 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.546147 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.546150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.546177 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.547860 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.548357 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.548360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.548362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.548453 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.548751 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.548755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.548757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.548974 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.549085 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.549463 (+ 378us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.549589 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 11:47:08.549759 3797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.540005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36449 (local address 127.0.0.1:55114)
0806 11:47:08.540255 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.540284 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.540470 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.540956 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.540960 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.541217 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.541329 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.541335 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.542150 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.542155 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.542940 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.542952 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.543424 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.543427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.543539 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.544145 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.544161 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.545939 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.547999 (+ 2060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.548003 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.548005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.548243 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.548552 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.548556 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.548558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.548655 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.549089 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.549093 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.549248 (+ 155us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.549370 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.549569 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 11:47:08.551400 3054 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.172.252:36449: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "b898a5bd1948400f9a2398176403abfa"
member_type: NON_VOTER
last_known_addr {
host: "127.26.172.252"
port: 36449
}
attrs {
promote: true
}
}
dest_uuid: "c964b9ce3b3c4819b7094acd447672f0"
cas_config_opid_index: 5
I20260806 11:47:08.552078 3054 consensus_queue.cc:237] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } }
I20260806 11:47:08.553508 4076 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER b898a5bd1948400f9a2398176403abfa (127.26.172.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.555121 4003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:08.556051 4076 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.172.252:36449
I20260806 11:47:08.556607 3813 master.cc:537] Master@127.26.172.252:36449 shutting down...
I20260806 11:47:08.556782 4003 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 FOLLOWER]: Refusing update from remote peer c964b9ce3b3c4819b7094acd447672f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 11:47:08.557586 3807 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:08.558710 3808 sys_catalog.cc:455] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.558871 3808 sys_catalog.cc:458] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:08.559998 3797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.553949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:39155 (local address 127.0.0.1:42376)
0806 11:47:08.554271 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.554605 (+ 334us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.554727 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.555292 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.555295 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.555313 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:08.555439 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.555446 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.556588 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.556592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.557999 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.558014 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.559414 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.559418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.559528 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.559600 (+ 72us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.559694 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.559813 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217}
I20260806 11:47:08.560087 4048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.554409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42376 (local address 127.26.172.253:39155)
0806 11:47:08.554546 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.554553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.554817 (+ 264us) server_negotiation.cc:407] Connection header received
0806 11:47:08.554913 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.554917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.554995 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.555109 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:08.555582 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.556429 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.558173 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.558983 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.559126 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.559338 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.559776 (+ 438us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.559942 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 11:47:08.561297 3038 consensus_peers.cc:487] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 -> Peer b898a5bd1948400f9a2398176403abfa (127.26.172.252:36449): Couldn't send request to peer b898a5bd1948400f9a2398176403abfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 11:47:08.561543 3884 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 LEARNER]: Refusing update from remote peer c964b9ce3b3c4819b7094acd447672f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 11:47:08.562091 4076 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 11:47:08.564569 3884 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER b898a5bd1948400f9a2398176403abfa (127.26.172.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.567724 3925 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: SysCatalogTable state changed. Reason: New leader c964b9ce3b3c4819b7094acd447672f0. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.567883 3925 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: This master's current role is: LEARNER
I20260806 11:47:08.568001 3925 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: NON_VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: true } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.568090 3925 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: This master's current role is: LEARNER
I20260806 11:47:08.568795 3813 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:08.569136 3813 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:08.569255 3813 tablet_replica.cc:330] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: stopping tablet replica
I20260806 11:47:08.569352 3808 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0: attempting to promote NON_VOTER f98f52fcd6164bca9e52b20f50e562da to VOTER
I20260806 11:47:08.569912 3808 consensus_queue.cc:237] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } }
I20260806 11:47:08.571856 3884 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 LEARNER]: Refusing update from remote peer c964b9ce3b3c4819b7094acd447672f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 11:47:08.572239 4081 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260806 11:47:08.572767 3038 consensus_peers.cc:487] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 -> Peer b898a5bd1948400f9a2398176403abfa (127.26.172.252:36449): Couldn't send request to peer b898a5bd1948400f9a2398176403abfa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 11:47:08.574548 3807 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f98f52fcd6164bca9e52b20f50e562da (127.26.172.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.576505 3807 sys_catalog.cc:455] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.576673 3807 sys_catalog.cc:458] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:08.576825 3807 sys_catalog.cc:455] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.576921 3807 sys_catalog.cc:458] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:08.577389 3813 master.cc:552] Master@127.26.172.252:36449 shutdown complete.
I20260806 11:47:08.577441 3813 master_runner.cc:305] Clearing existing system tablet
I20260806 11:47:08.577728 3813 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:08.577791 3813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:08.578212 3884 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f98f52fcd6164bca9e52b20f50e562da (127.26.172.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.579912 4080 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.580039 4080 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:47:08.580718 3813 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 11:47:08.581674 4085 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:08.581888 3813 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:08.582021 3813 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 11:47:08.582067 3813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal
uuid: "b898a5bd1948400f9a2398176403abfa"
format_stamp: "Formatted at 2026-08-06 11:47:08 on dist-test-slave-7z32"
server_key: "49e6369efeb094740a5746e72431da40"
server_key_iv: "facd71481bce3a20c13e8f690a9fa0f6"
server_key_version: "encryptionkey@0"
I20260806 11:47:08.584172 3813 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:08.586453 3813 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 11:47:08.586582 3813 log.cc:1196] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 11:47:08.586884 3813 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Deleting consensus metadata
I20260806 11:47:08.587088 3813 master_runner.cc:315] Copying system tablet from 127.26.172.254:43861
I20260806 11:47:08.588493 3813 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: tablet copy: Beginning tablet copy session from remote peer at address 127.26.172.254:43861
I20260806 11:47:08.597306 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.589233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45894 (local address 127.26.172.254:43861)
0806 11:47:08.589386 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.589393 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.589605 (+ 212us) server_negotiation.cc:407] Connection header received
0806 11:47:08.589777 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.589780 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.589835 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.589932 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.590401 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.591087 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.591993 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.592219 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.592332 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.593591 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.593595 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.593598 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.593654 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.595506 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.595949 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.595954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.595956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.596055 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.596398 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.596402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.596404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.596610 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.596724 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.597001 (+ 277us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.597123 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 11:47:08.597333 4092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.589161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:45894)
0806 11:47:08.589508 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.589519 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.589663 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.589951 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.589954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.590183 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.590272 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.590278 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.591200 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.591205 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.591821 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.591853 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.592341 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.592352 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.592435 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.593055 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.593068 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.593432 (+ 364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.595621 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.595625 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.595627 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.595844 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.596195 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.596198 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.596200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.596292 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.596714 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.596716 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.596827 (+ 111us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.596941 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.597112 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":95,"threads_started":1}
I20260806 11:47:08.598201 3074 tablet_copy_service.cc:140] P c964b9ce3b3c4819b7094acd447672f0: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b898a5bd1948400f9a2398176403abfa ({username='oryx', principal='oryx/127.26.172.252@KRBTEST.COM'} at 127.0.0.1:45894)
I20260806 11:47:08.598354 3074 tablet_copy_service.cc:161] P c964b9ce3b3c4819b7094acd447672f0: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b898a5bd1948400f9a2398176403abfa at {username='oryx', principal='oryx/127.26.172.252@KRBTEST.COM'} at 127.0.0.1:45894: session id = b898a5bd1948400f9a2398176403abfa-00000000000000000000000000000000
I20260806 11:47:08.599396 3074 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 11:47:08.600888 3813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 11:47:08.603117 3813 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: tablet copy: Starting download of 0 data blocks...
I20260806 11:47:08.603420 3813 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: tablet copy: Starting download of 1 WAL segments...
I20260806 11:47:08.605073 3813 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 11:47:08.607107 3074 tablet_copy_service.cc:342] P c964b9ce3b3c4819b7094acd447672f0: Request end of tablet copy session b898a5bd1948400f9a2398176403abfa-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.172.252@KRBTEST.COM'} at 127.0.0.1:45894
I20260806 11:47:08.607228 3074 tablet_copy_service.cc:433] P c964b9ce3b3c4819b7094acd447672f0: ending tablet copy session b898a5bd1948400f9a2398176403abfa-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b898a5bd1948400f9a2398176403abfa
I20260806 11:47:08.615849 3813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:08.618528 4096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:08.618528 4093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:08.618583 4094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:08.623279 3813 server_base.cc:1034] running on GCE node
I20260806 11:47:08.623649 3813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:08.624065 3813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:08.625237 3813 hybrid_clock.cc:648] HybridClock initialized: now 1786016828625221 us; error 40 us; skew 500 ppm
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016828, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:08.627089 3813 init.cc:377] Logged in from keytab as oryx/127.26.172.252@KRBTEST.COM (short username oryx)
I20260806 11:47:08.627686 3813 webserver.cc:460] Webserver started at http://127.26.172.252:45335/ using document root <none> and password file <none>
I20260806 11:47:08.627902 3813 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:08.627964 3813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:08.629325 3813 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 11:47:08.630503 4110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:08.630764 3813 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 11:47:08.630901 3813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal
uuid: "b898a5bd1948400f9a2398176403abfa"
format_stamp: "Formatted at 2026-08-06 11:47:08 on dist-test-slave-7z32"
server_key: "49e6369efeb094740a5746e72431da40"
server_key_iv: "facd71481bce3a20c13e8f690a9fa0f6"
server_key_version: "encryptionkey@0"
I20260806 11:47:08.631027 3813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:08.649395 3813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:08.651938 3813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:08.657819 3813 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.252:36449
I20260806 11:47:08.658654 3813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
I20260806 11:47:08.660614 4177 sys_catalog.cc:263] Verifying existing consensus state
I20260806 11:47:08.661633 4177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Bootstrap starting.
I20260806 11:47:08.661939 4176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.252:36449 every 8 connection(s)
I20260806 11:47:08.676836 4177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:47:08.677263 4177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Bootstrap complete.
I20260806 11:47:08.678025 4177 raft_consensus.cc:348] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } }
I20260806 11:47:08.678181 4177 raft_consensus.cc:729] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b898a5bd1948400f9a2398176403abfa, State: Initialized, Role: LEARNER
I20260806 11:47:08.678344 4177 consensus_queue.cc:260] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } }
I20260806 11:47:08.678968 4177 sys_catalog.cc:564] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:08.680128 4181 sys_catalog.cc:455] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:08.680393 4181 sys_catalog.cc:458] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: This master's current role is: LEARNER
I20260806 11:47:08.682649 4197 catalog_manager.cc:1259] Loaded cluster ID: 209097add5a84419abc13b8342ac1d7c
I20260806 11:47:08.682765 4197 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: loading cluster ID for follower catalog manager: success
I20260806 11:47:08.684980 4197 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: acquiring CA information for follower catalog manager: success
I20260806 11:47:08.686394 4197 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 11:47:08.703217 3662 heartbeater.cc:503] Master 127.26.172.254:43861 was elected leader, sending a full tablet report...
W20260806 11:47:08.748394 4075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:08.748931 4075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:08.749009 4075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:08.755254 4075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:08.755373 4075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:08.755487 4075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:47:08.762480 4075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab
--principal=oryx/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:41227
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=33397
--tserver_master_addrs=127.26.172.254:43861,127.26.172.253:39155,127.26.172.252:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:08.764297 4075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:08.766034 4075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:08.779910 4207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:08.779996 4209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:08.780072 4206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:08.780488 4075 server_base.cc:1034] running on GCE node
I20260806 11:47:08.781217 4075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:08.782176 4075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:08.783396 4075 hybrid_clock.cc:648] HybridClock initialized: now 1786016828783375 us; error 52 us; skew 500 ppm
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016828, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:08.794369 4075 init.cc:377] Logged in from keytab as oryx/127.26.172.193@KRBTEST.COM (short username oryx)
I20260806 11:47:08.796070 4075 webserver.cc:460] Webserver started at http://127.26.172.193:33397/ using document root <none> and password file <none>
I20260806 11:47:08.797148 4075 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:08.797343 4075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:08.803579 4075 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:47:08.807188 4222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:08.809305 4075 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:47:08.809549 4075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "5e03c88772984603871093691a7dcfb7"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "06136e99397a718c805b4a5b5583896e"
server_key_iv: "d1072b46cd995c638c8460249d808a0c"
server_key_version: "encryptionkey@0"
I20260806 11:47:08.810439 4075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:08.829109 4075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:08.834692 4075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:08.835094 4075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:08.836144 4075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:08.837939 4075 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:08.838044 4075 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:08.838130 4075 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:08.838184 4075 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:08.852443 4075 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:41227
I20260806 11:47:08.852465 4372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:41227 every 8 connection(s)
I20260806 11:47:08.853971 4075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:47:08.863653 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 4075
I20260806 11:47:08.863921 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 3301
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016828, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.253@KRBTEST.COM
I20260806 11:47:08.876322 4048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.856615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:45933 (local address 127.26.172.253:39155)
0806 11:47:08.856805 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.856810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.858144 (+ 1334us) server_negotiation.cc:407] Connection header received
0806 11:47:08.859859 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.859865 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.859981 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.860090 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.862131 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.863011 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.864870 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.865210 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.865301 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.871170 (+ 5869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.871177 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.871182 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.871226 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.873451 (+ 2225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.874220 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.874225 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.874230 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.874311 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.874775 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.874781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.874785 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.875089 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.875161 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.875925 (+ 764us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.876079 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 11:47:08.878196 4382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.857112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:39155 (local address 127.26.172.193:45933)
0806 11:47:08.857917 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.857993 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.859474 (+ 1481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.860359 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.860368 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.861127 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.861926 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.861941 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.863174 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.863178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.864671 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.864687 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.865570 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.865576 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.865814 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.868803 (+ 2989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.868837 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.870902 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.873633 (+ 2731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.873644 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.873721 (+ 77us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.874105 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.874424 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.874429 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.874434 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.874618 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.875244 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.875254 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.875643 (+ 389us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.876580 (+ 937us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.877000 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":128,"spinlock_wait_cycles":14592,"thread_start_us":804,"threads_started":1}
I20260806 11:47:08.879711 4376 heartbeater.cc:347] Connected to a master server at 127.26.172.253:39155
I20260806 11:47:08.879969 4376 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:08.880692 4376 heartbeater.cc:511] Master 127.26.172.253:39155 requested a full tablet report, sending...
I20260806 11:47:08.882529 3871 ts_manager.cc:194] Registered new tserver with Master: 5e03c88772984603871093691a7dcfb7 (127.26.172.193:41227)
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016828, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
Aug 06 11:47:08 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016828, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.252@KRBTEST.COM
I20260806 11:47:08.907684 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.856603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:60641 (local address 127.26.172.254:43861)
0806 11:47:08.856845 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.856851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.858454 (+ 1603us) server_negotiation.cc:407] Connection header received
0806 11:47:08.859983 (+ 1529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.859987 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.860065 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.860166 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.862117 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.862725 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.898879 (+ 36154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.899303 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.899449 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.903466 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.903471 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.903474 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.903514 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.905432 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.905978 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.905982 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.905984 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.906080 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.906385 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.906388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.906390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.906694 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.906815 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.907315 (+ 500us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.907493 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260806 11:47:08.908283 4385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.857112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.193:60641)
0806 11:47:08.858280 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.858298 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.859474 (+ 1176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.860601 (+ 1127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.860604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.861179 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.861917 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.861937 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.862952 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.862956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.894917 (+ 31961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.894970 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.899670 (+ 4700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.899676 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.899828 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.900837 (+ 1009us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.900850 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.903100 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.905609 (+ 2509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.905613 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.905614 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.905843 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.906182 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.906186 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.906188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.906278 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.906882 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.906889 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.907065 (+ 176us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.907201 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.907453 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1036,"mutex_wait_us":33,"spinlock_wait_cycles":19200,"thread_start_us":216,"threads_started":1}
I20260806 11:47:08.908651 4386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.858470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36449 (local address 127.26.172.193:39249)
0806 11:47:08.859015 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:08.859032 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:08.859509 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:08.860550 (+ 1041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:08.860553 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:08.861258 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:08.861926 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.861941 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.863400 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.863403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.895803 (+ 32400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:08.895815 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.896756 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.896762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:08.896899 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.900822 (+ 3923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:08.900842 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:08.903710 (+ 2868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:08.906600 (+ 2890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.906603 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.906605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.906887 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.907295 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:08.907299 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:08.907301 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:08.907395 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:08.907934 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:08.907937 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:08.908049 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 11:47:08.908152 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 11:47:08.908334 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":31333,"spinlock_wait_cycles":43136,"thread_start_us":124,"threads_started":1}
I20260806 11:47:08.909296 4375 heartbeater.cc:347] Connected to a master server at 127.26.172.254:43861
I20260806 11:47:08.909332 4387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:08.858609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:39249 (local address 127.26.172.252:36449)
0806 11:47:08.859009 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:08.859015 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:08.859134 (+ 119us) server_negotiation.cc:407] Connection header received
0806 11:47:08.860330 (+ 1196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:08.860333 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:08.860386 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:08.860472 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:08.862137 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.863271 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.895990 (+ 32719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:08.896422 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:08.896540 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:08.903994 (+ 7454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:08.904002 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:08.904008 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:08.904055 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:08.906439 (+ 2384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.907035 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.907040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.907041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.907152 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:08.907514 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:08.907518 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:08.907519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:08.907764 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:08.907872 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:08.908988 (+ 1116us) server_negotiation.cc:299] Negotiation successful
0806 11:47:08.909148 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":101,"threads_started":1}
I20260806 11:47:08.909425 4375 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:08.909638 4375 heartbeater.cc:511] Master 127.26.172.254:43861 requested a full tablet report, sending...
I20260806 11:47:08.910261 4374 heartbeater.cc:347] Connected to a master server at 127.26.172.252:36449
I20260806 11:47:08.910374 4374 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:08.910549 4374 heartbeater.cc:511] Master 127.26.172.252:36449 requested a full tablet report, sending...
I20260806 11:47:08.910982 3054 ts_manager.cc:194] Re-registered known tserver with Master: 5e03c88772984603871093691a7dcfb7 (127.26.172.193:41227)
I20260806 11:47:08.911778 3054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:60641
I20260806 11:47:08.911947 4132 ts_manager.cc:194] Registered new tserver with Master: 5e03c88772984603871093691a7dcfb7 (127.26.172.193:41227)
I20260806 11:47:08.913218 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:34161
--local_ip_for_outbound_sockets=127.26.172.194
--tserver_master_addrs=127.26.172.254:43861
--webserver_port=42991
--webserver_interface=127.26.172.194
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab
--principal=oryx/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.172.254:43861,127.26.172.253:39155
--tserver_master_addrs=127.26.172.254:43861,127.26.172.253:39155,127.26.172.252:36449 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:47:09.065029 4387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.060521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55124 (local address 127.26.172.252:36449)
0806 11:47:09.060718 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.060722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.060735 (+ 13us) server_negotiation.cc:407] Connection header received
0806 11:47:09.060793 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.060796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.060856 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.060952 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:09.061469 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.062091 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.063815 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.064322 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.064539 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.064696 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.064751 (+ 55us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.064868 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260806 11:47:09.065043 3797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.060197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36449 (local address 127.0.0.1:55124)
0806 11:47:09.060348 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.060366 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.060490 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.061046 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.061050 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.061100 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:09.061258 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.061268 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.062250 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.062254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.063623 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.063639 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.064509 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.064513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.064615 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.064663 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.064734 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.064846 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 11:47:09.066133 4139 raft_consensus.cc:1203] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 11:47:09.066737 4181 sys_catalog.cc:455] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader c964b9ce3b3c4819b7094acd447672f0. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:09.067003 4181 sys_catalog.cc:458] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: This master's current role is: LEARNER
W20260806 11:47:09.077154 4388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:09.077678 4388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:09.077746 4388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:09.082803 4388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:09.082983 4388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:09.083060 4388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:47:09.089586 4388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab
--principal=oryx/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:34161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=42991
--tserver_master_addrs=127.26.172.254:43861,127.26.172.253:39155,127.26.172.252:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:09.091272 4388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:09.092674 4388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:09.107354 4399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:09.107360 4397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:09.107627 4388 server_base.cc:1034] running on GCE node
W20260806 11:47:09.107354 4396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:09.108539 4388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:09.109505 4388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:09.110805 4388 hybrid_clock.cc:648] HybridClock initialized: now 1786016829110767 us; error 54 us; skew 500 ppm
Aug 06 11:47:09 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016829, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:09.115841 4388 init.cc:377] Logged in from keytab as oryx/127.26.172.194@KRBTEST.COM (short username oryx)
I20260806 11:47:09.117383 4388 webserver.cc:460] Webserver started at http://127.26.172.194:42991/ using document root <none> and password file <none>
I20260806 11:47:09.118212 4388 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:09.118379 4388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:09.124307 4388 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:47:09.127885 4408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:09.129988 4388 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:47:09.130241 4388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "f09eefa997904f9ca9192c8deaa28ce2"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "b75a1b0bd5bb2cb1d1c56b9aebc78cc3"
server_key_iv: "1e3db0423c4aa6cd745cb5c633d09747"
server_key_version: "encryptionkey@0"
I20260806 11:47:09.131209 4388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:09.151612 4388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:09.157351 4388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:09.157630 4388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:09.158452 4388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:09.159641 4388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:09.159703 4388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:09.159751 4388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:09.159768 4388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:09.172585 4388 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:34161
I20260806 11:47:09.172750 4557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:34161 every 8 connection(s)
I20260806 11:47:09.173986 4388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:47:09.176330 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 4388
I20260806 11:47:09.176604 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 3485
I20260806 11:47:09.203274 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:45327
--local_ip_for_outbound_sockets=127.26.172.195
--tserver_master_addrs=127.26.172.254:43861
--webserver_port=42229
--webserver_interface=127.26.172.195
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab
--principal=oryx/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.172.254:43861,127.26.172.253:39155
--tserver_master_addrs=127.26.172.254:43861,127.26.172.253:39155,127.26.172.252:36449 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:47:09 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016829, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.253@KRBTEST.COM
Aug 06 11:47:09 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016829, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
Aug 06 11:47:09 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016829, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.252@KRBTEST.COM
I20260806 11:47:09.214958 4387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.194538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:34273 (local address 127.26.172.252:36449)
0806 11:47:09.194739 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.194745 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.195300 (+ 555us) server_negotiation.cc:407] Connection header received
0806 11:47:09.195744 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.195751 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.195840 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.195903 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.198521 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.199475 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.201946 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.202362 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.202467 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.210044 (+ 7577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.210052 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.210056 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.210096 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.212240 (+ 2144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.212806 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.212810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.212811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.212902 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.213222 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.213225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.213227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.213515 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.213598 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.214559 (+ 961us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.214752 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 11:47:09.214993 4048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.192145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:33949 (local address 127.26.172.253:39155)
0806 11:47:09.192386 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.192403 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.194078 (+ 1675us) server_negotiation.cc:407] Connection header received
0806 11:47:09.195800 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.195804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.195865 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.195953 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.198514 (+ 2561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.199474 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.201958 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.202337 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.202429 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.208121 (+ 5692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.208126 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.208129 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.208176 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.211685 (+ 3509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.212402 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.212406 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.212408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.212508 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.213222 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.213225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.213227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.213523 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.213602 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.214559 (+ 957us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.214761 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260806 11:47:09.216787 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.182359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:47395 (local address 127.26.172.254:43861)
0806 11:47:09.182581 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.182590 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.194254 (+ 11664us) server_negotiation.cc:407] Connection header received
0806 11:47:09.195706 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.195709 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.195782 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.195846 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.198519 (+ 2673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.199474 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.201957 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.202337 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.202430 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.208121 (+ 5691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.208126 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.208129 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.208163 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.210940 (+ 2777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.214076 (+ 3136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.214085 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.214090 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.214315 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.214962 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.214968 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.214973 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.215362 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.215474 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.216266 (+ 792us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.216489 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 11:47:09.217603 4568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.194735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36449 (local address 127.26.172.194:34273)
0806 11:47:09.195143 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.195160 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.195416 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.196315 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.196329 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.197173 (+ 844us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:09.198299 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.198326 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.199696 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.199702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.201773 (+ 2071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.201791 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.202733 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.202737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.203137 (+ 400us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.204440 (+ 1303us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:09.204473 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:09.209792 (+ 5319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:09.212401 (+ 2609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.212405 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.212407 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.212689 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.213018 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.213021 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.213023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.213119 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.213675 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:09.213684 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:09.214192 (+ 508us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.215244 (+ 1052us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.215736 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":611,"spinlock_wait_cycles":49280,"thread_start_us":173,"threads_started":1}
I20260806 11:47:09.217715 4565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.177643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.194:47395)
0806 11:47:09.194143 (+ 16500us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.194157 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.195402 (+ 1245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.196312 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.196325 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.197182 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:09.198293 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.198320 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.199684 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.199687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.201749 (+ 2062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.201765 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.202697 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.202702 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.203121 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.204516 (+ 1395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:09.204542 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:09.207797 (+ 3255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:09.211235 (+ 3438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.211249 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.211286 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.211942 (+ 656us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.214548 (+ 2606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.214553 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.214557 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.214780 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.215720 (+ 940us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:09.215726 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:09.215987 (+ 261us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.217117 (+ 1130us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.217396 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16399,"mutex_wait_us":15683,"spinlock_wait_cycles":23680,"thread_start_us":200,"threads_started":1}
I20260806 11:47:09.217603 4564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.177641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:39155 (local address 127.26.172.194:33949)
0806 11:47:09.193821 (+ 16180us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.193914 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.195400 (+ 1486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.196312 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.196325 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.197190 (+ 865us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:09.198305 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.198320 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.199684 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.199687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.201752 (+ 2065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.201765 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.202697 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.202702 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.203122 (+ 420us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.205026 (+ 1904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:09.205041 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:09.207797 (+ 2756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:09.211906 (+ 4109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.211910 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.211914 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.212253 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.212697 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.212700 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.212703 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.213055 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.213675 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:09.213684 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:09.214192 (+ 508us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.215650 (+ 1458us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.215860 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15876,"mutex_wait_us":643,"spinlock_wait_cycles":53632,"thread_start_us":14866,"threads_started":1}
I20260806 11:47:09.219945 4559 heartbeater.cc:347] Connected to a master server at 127.26.172.254:43861
I20260806 11:47:09.220029 4562 heartbeater.cc:347] Connected to a master server at 127.26.172.253:39155
I20260806 11:47:09.220348 4562 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:09.221174 4562 heartbeater.cc:511] Master 127.26.172.253:39155 requested a full tablet report, sending...
I20260806 11:47:09.220029 4558 heartbeater.cc:347] Connected to a master server at 127.26.172.252:36449
I20260806 11:47:09.221920 4558 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:09.222111 4558 heartbeater.cc:511] Master 127.26.172.252:36449 requested a full tablet report, sending...
I20260806 11:47:09.220348 4559 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:09.222500 4559 heartbeater.cc:511] Master 127.26.172.254:43861 requested a full tablet report, sending...
I20260806 11:47:09.223346 3054 ts_manager.cc:194] Re-registered known tserver with Master: f09eefa997904f9ca9192c8deaa28ce2 (127.26.172.194:34161)
I20260806 11:47:09.223578 4132 ts_manager.cc:194] Registered new tserver with Master: f09eefa997904f9ca9192c8deaa28ce2 (127.26.172.194:34161)
I20260806 11:47:09.224148 3054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:47395
I20260806 11:47:09.224481 3871 ts_manager.cc:194] Registered new tserver with Master: f09eefa997904f9ca9192c8deaa28ce2 (127.26.172.194:34161)
W20260806 11:47:09.381618 4569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:09.382040 4569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:09.382097 4569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:09.387846 4569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:09.387974 4569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:09.388051 4569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:47:09.396063 4569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab
--principal=oryx/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:45327
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=42229
--tserver_master_addrs=127.26.172.254:43861,127.26.172.253:39155,127.26.172.252:36449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:09.397826 4569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:09.399302 4569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:09.413069 4580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:09.413079 4579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:09.413069 4582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:09.413727 4569 server_base.cc:1034] running on GCE node
I20260806 11:47:09.414445 4569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:09.415405 4569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:09.416721 4569 hybrid_clock.cc:648] HybridClock initialized: now 1786016829416673 us; error 71 us; skew 500 ppm
Aug 06 11:47:09 dist-test-slave-7z32 krb5kdc[2992](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016829, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:09.421273 4569 init.cc:377] Logged in from keytab as oryx/127.26.172.195@KRBTEST.COM (short username oryx)
I20260806 11:47:09.422704 4569 webserver.cc:460] Webserver started at http://127.26.172.195:42229/ using document root <none> and password file <none>
I20260806 11:47:09.423565 4569 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:09.423725 4569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:09.429755 4569 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 11:47:09.433471 4593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:09.435775 4569 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:09.436064 4569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "0b4ad9e1f159423bb287646159adc19a"
format_stamp: "Formatted at 2026-08-06 11:47:07 on dist-test-slave-7z32"
server_key: "f820523b4adb28153d5c735811e2b3fd"
server_key_iv: "94926d46ef6a38468d6f2fd03dd3bf43"
server_key_version: "encryptionkey@0"
I20260806 11:47:09.436887 4569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:09.469354 4569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:09.473255 4569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:09.473500 4569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:09.474222 4569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:09.475467 4569 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:09.475562 4569 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:09.475642 4569 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:09.475700 4569 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:09.487658 4569 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:45327
I20260806 11:47:09.487788 4740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:45327 every 8 connection(s)
I20260806 11:47:09.489020 4569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:47:09.499387 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 4569
Aug 06 11:47:09 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016829, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.252@KRBTEST.COM
Aug 06 11:47:09 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016829, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.253@KRBTEST.COM
Aug 06 11:47:09 dist-test-slave-7z32 krb5kdc[2992](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016829, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:09.512143 4387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.493846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:48253 (local address 127.26.172.252:36449)
0806 11:47:09.494029 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.494034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.494054 (+ 20us) server_negotiation.cc:407] Connection header received
0806 11:47:09.494775 (+ 721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.494778 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.494912 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.495050 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.499020 (+ 3970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.499809 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.501071 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.501410 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.501495 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.506682 (+ 5187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.506687 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.506690 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.506724 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.509019 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.509847 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.509852 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.509855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.509958 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.510488 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.510493 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.510498 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.510786 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.510908 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.511775 (+ 867us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.511934 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 11:47:09.513332 4048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.491674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:36725 (local address 127.26.172.253:39155)
0806 11:47:09.491831 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.491836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.493500 (+ 1664us) server_negotiation.cc:407] Connection header received
0806 11:47:09.494444 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.494450 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.494522 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.494756 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.498412 (+ 3656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.499311 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.500917 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.501267 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.501392 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.506683 (+ 5291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.506687 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.506690 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.506724 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.510664 (+ 3940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.511235 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.511239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.511241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.511334 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.511647 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.511654 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.511658 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.511935 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.512030 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.512864 (+ 834us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.513088 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 11:47:09.514179 4751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.493574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36449 (local address 127.26.172.195:48253)
0806 11:47:09.493909 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.493925 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.494243 (+ 318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.495119 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.495131 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.495962 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:09.496914 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.496942 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.499997 (+ 3055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.500001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.500918 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.500930 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.501686 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.501707 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.502089 (+ 382us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.502588 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:09.502607 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:09.506494 (+ 3887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:09.509196 (+ 2702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.509208 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.509236 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.509701 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.510093 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.510097 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.510099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.510344 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.510995 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:09.511004 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:09.511441 (+ 437us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.512398 (+ 957us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.512871 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":263,"thread_start_us":116,"threads_started":1}
I20260806 11:47:09.514528 4750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.492157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:39155 (local address 127.26.172.195:36725)
0806 11:47:09.493336 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.493354 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.494182 (+ 828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.495146 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.495151 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.495961 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:09.496923 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.496946 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.499528 (+ 2582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.499534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.500699 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.500720 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.501593 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.501598 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.501700 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.502454 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:09.502476 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:09.506376 (+ 3900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:09.510812 (+ 4436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.510818 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.510846 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.511118 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.511444 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.511447 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.511449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.511534 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.512134 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:09.512137 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:09.512242 (+ 105us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.512361 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.513077 (+ 716us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1054,"mutex_wait_us":723,"spinlock_wait_cycles":9088,"thread_start_us":310,"threads_started":1}
I20260806 11:47:09.517057 4744 heartbeater.cc:347] Connected to a master server at 127.26.172.253:39155
I20260806 11:47:09.517374 4744 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:09.517660 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.491659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:34901 (local address 127.26.172.254:43861)
0806 11:47:09.491854 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.491860 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.493006 (+ 1146us) server_negotiation.cc:407] Connection header received
0806 11:47:09.494489 (+ 1483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.494493 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.494552 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.494617 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.497255 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.497936 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.500360 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.500745 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.500838 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.507375 (+ 6537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.507379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.507388 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.507455 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.509727 (+ 2272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.515402 (+ 5675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.515407 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.515409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.515550 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.516164 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.516170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.516175 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.516571 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.516680 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.517328 (+ 648us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.517493 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 11:47:09.518142 4744 heartbeater.cc:511] Master 127.26.172.253:39155 requested a full tablet report, sending...
I20260806 11:47:09.518654 4749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.492155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.195:34901)
0806 11:47:09.492795 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.492860 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.494165 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.495119 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.495131 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.495962 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:09.496914 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.496942 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.498324 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.498328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.500146 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.500158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.501134 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.501138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.501389 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.502308 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:09.502339 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:09.507177 (+ 4838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:09.513088 (+ 5911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.513093 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.513095 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.513409 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.515695 (+ 2286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:09.515699 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:09.515701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:09.515989 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:09.516726 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:09.516729 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:09.516831 (+ 102us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.516927 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.517125 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":322,"thread_start_us":163,"threads_started":1}
I20260806 11:47:09.518858 4741 heartbeater.cc:347] Connected to a master server at 127.26.172.252:36449
I20260806 11:47:09.518989 4741 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:09.519181 4741 heartbeater.cc:511] Master 127.26.172.252:36449 requested a full tablet report, sending...
I20260806 11:47:09.519747 3871 ts_manager.cc:194] Registered new tserver with Master: 0b4ad9e1f159423bb287646159adc19a (127.26.172.195:45327)
I20260806 11:47:09.520360 4132 ts_manager.cc:194] Registered new tserver with Master: 0b4ad9e1f159423bb287646159adc19a (127.26.172.195:45327)
I20260806 11:47:09.521994 4742 heartbeater.cc:347] Connected to a master server at 127.26.172.254:43861
I20260806 11:47:09.522130 4742 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:09.522382 4758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.503795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55140 (local address 127.26.172.252:36449)
0806 11:47:09.505197 (+ 1402us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.505202 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.506876 (+ 1674us) server_negotiation.cc:407] Connection header received
0806 11:47:09.506932 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.506936 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.506998 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.508145 (+ 1147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.509271 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.510152 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.511461 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.511962 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.512088 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.516073 (+ 3985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.516079 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.516092 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.516130 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.518990 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.520033 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.520040 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.520042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.520168 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.520588 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.520608 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.520611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.520936 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.521108 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.521916 (+ 808us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.522108 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1290,"thread_start_us":105,"threads_started":1}
I20260806 11:47:09.522392 4742 heartbeater.cc:511] Master 127.26.172.254:43861 requested a full tablet report, sending...
I20260806 11:47:09.523236 3054 ts_manager.cc:194] Re-registered known tserver with Master: 0b4ad9e1f159423bb287646159adc19a (127.26.172.195:45327)
I20260806 11:47:09.524071 3054 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:34901
I20260806 11:47:09.524647 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.503149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42378 (local address 127.26.172.253:39155)
0806 11:47:09.503960 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.503966 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.503985 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:47:09.504041 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.504045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.504132 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.504243 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.505795 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.507221 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.508586 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.509006 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.509147 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.511352 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.511359 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.511366 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.511476 (+ 110us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.515847 (+ 4371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.522053 (+ 6206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.522060 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.522065 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.522214 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.523058 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.523063 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.523065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.523378 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.524203 (+ 825us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.524290 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.524465 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":139,"threads_started":1}
I20260806 11:47:09.526811 4762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.504420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45898 (local address 127.26.172.254:43861)
0806 11:47:09.505247 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.505253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.505476 (+ 223us) server_negotiation.cc:407] Connection header received
0806 11:47:09.513617 (+ 8141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.513622 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.513714 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.514850 (+ 1136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.515025 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.516305 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.518294 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.518740 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.519470 (+ 730us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.521359 (+ 1889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.521364 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.521368 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.521414 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.524441 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.525053 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.525058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.525060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.525179 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.525545 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.525549 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.525551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.525848 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.526019 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.526523 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.526677 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":113,"threads_started":1}
I20260806 11:47:09.530694 3054 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:47:09.534749 3054 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:47:09.538698 4081 sys_catalog.cc:455] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: NON_VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: true } } }
I20260806 11:47:09.539175 4081 sys_catalog.cc:458] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:09.544725 4767 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0: attempting to promote NON_VOTER b898a5bd1948400f9a2398176403abfa to VOTER
I20260806 11:47:09.545168 4767 consensus_queue.cc:237] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } }
I20260806 11:47:09.546757 3884 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 FOLLOWER]: Refusing update from remote peer c964b9ce3b3c4819b7094acd447672f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 11:47:09.547197 4140 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 LEARNER]: Refusing update from remote peer c964b9ce3b3c4819b7094acd447672f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260806 11:47:09.547736 4769 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 11:47:09.548056 4769 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260806 11:47:09.551047 4767 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, b898a5bd1948400f9a2398176403abfa (127.26.172.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:09.551682 3884 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, b898a5bd1948400f9a2398176403abfa (127.26.172.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:09.551666 4139 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, b898a5bd1948400f9a2398176403abfa (127.26.172.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:09.553054 4767 sys_catalog.cc:455] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:09.553218 4767 sys_catalog.cc:458] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:09.553401 4767 sys_catalog.cc:455] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:09.553530 4767 sys_catalog.cc:458] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:09.553686 4767 sys_catalog.cc:455] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:09.553820 4767 sys_catalog.cc:458] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:09.554445 4781 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:09.554735 4781 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:47:09.555692 4181 sys_catalog.cc:455] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c964b9ce3b3c4819b7094acd447672f0" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:09.555874 4181 sys_catalog.cc:458] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:47:09.566577 4785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.559289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:41227 (local address 127.0.0.1:34154)
0806 11:47:09.560009 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.560026 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.560261 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.560807 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.560810 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.560835 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:09.560956 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.560961 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.563054 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.563059 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.564469 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.564480 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.566073 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.566077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.566194 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.566229 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.566306 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.566397 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":166,"threads_started":1}
I20260806 11:47:09.566731 4786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.559531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34154 (local address 127.26.172.193:41227)
0806 11:47:09.560233 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.560240 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.560266 (+ 26us) server_negotiation.cc:407] Connection header received
0806 11:47:09.560425 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.560430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.560607 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.560837 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:09.561066 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.562780 (+ 1714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.564670 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.565909 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.566076 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.566291 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.566368 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.566511 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":105,"threads_started":1}
I20260806 11:47:09.567899 3797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.557976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:45327 (local address 127.0.0.1:48566)
0806 11:47:09.558161 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.558180 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.558299 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.561337 (+ 3038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.561340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.561362 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:09.561447 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.561451 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.564250 (+ 2799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.564254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.565522 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.565535 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.567431 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.567436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.567529 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.567556 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.567631 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.567746 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 11:47:09.568282 4783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.558176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48566 (local address 127.26.172.195:45327)
0806 11:47:09.560746 (+ 2570us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.560761 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.560785 (+ 24us) server_negotiation.cc:407] Connection header received
0806 11:47:09.560865 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.560870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.561046 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.561385 (+ 339us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:09.561584 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.562930 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.565766 (+ 2836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.567263 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.567455 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.567613 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.567674 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.567808 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2426,"thread_start_us":182,"threads_started":1}
I20260806 11:47:09.568667 4784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.558666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:34161 (local address 127.0.0.1:60934)
0806 11:47:09.559787 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.559808 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.559948 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.563548 (+ 3600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.563554 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.563615 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:09.563842 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.563852 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.565555 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.565559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.566738 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.566750 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.568258 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.568265 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.568353 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.568388 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.568442 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.568516 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":180,"threads_started":1}
I20260806 11:47:09.569531 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.558093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60934 (local address 127.26.172.194:34161)
0806 11:47:09.559963 (+ 1870us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.559982 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.560015 (+ 33us) server_negotiation.cc:407] Connection header received
0806 11:47:09.560134 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.560144 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.563176 (+ 3032us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.564124 (+ 948us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:09.564329 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.565426 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.566919 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.567847 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.569007 (+ 1160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.569209 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.569270 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.569380 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1727,"thread_start_us":262,"threads_started":1}
I20260806 11:47:09.571909 4290 tablet_service.cc:1467] Processing CreateTablet for tablet a27420fc4c724a478bd3b8466666509f (DEFAULT_TABLE table=test-table [id=ac20dad8910a4cfbbc234bee8c7fa3a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:09.573674 4290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a27420fc4c724a478bd3b8466666509f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:09.573588 4654 tablet_service.cc:1467] Processing CreateTablet for tablet a27420fc4c724a478bd3b8466666509f (DEFAULT_TABLE table=test-table [id=ac20dad8910a4cfbbc234bee8c7fa3a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:09.573588 4469 tablet_service.cc:1467] Processing CreateTablet for tablet a27420fc4c724a478bd3b8466666509f (DEFAULT_TABLE table=test-table [id=ac20dad8910a4cfbbc234bee8c7fa3a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:09.575062 4469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a27420fc4c724a478bd3b8466666509f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:09.575062 4654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a27420fc4c724a478bd3b8466666509f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:09.587160 4787 tablet_bootstrap.cc:492] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: Bootstrap starting.
I20260806 11:47:09.587894 4789 tablet_bootstrap.cc:492] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: Bootstrap starting.
I20260806 11:47:09.589721 4787 tablet_bootstrap.cc:654] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:09.590651 4788 tablet_bootstrap.cc:492] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: Bootstrap starting.
I20260806 11:47:09.590749 4787 log.cc:824] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:09.590937 4789 tablet_bootstrap.cc:654] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:09.592156 4789 log.cc:824] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:09.593971 4787 tablet_bootstrap.cc:492] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: No bootstrap required, opened a new log
I20260806 11:47:09.594331 4787 ts_tablet_manager.cc:1397] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260806 11:47:09.594765 4788 tablet_bootstrap.cc:654] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:09.595528 4789 tablet_bootstrap.cc:492] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: No bootstrap required, opened a new log
I20260806 11:47:09.596035 4789 ts_tablet_manager.cc:1397] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260806 11:47:09.596309 4788 log.cc:824] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:09.598968 4787 raft_consensus.cc:348] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } } peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } }
I20260806 11:47:09.599346 4787 raft_consensus.cc:374] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:09.599413 4787 raft_consensus.cc:729] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e03c88772984603871093691a7dcfb7, State: Initialized, Role: FOLLOWER
I20260806 11:47:09.599963 4787 consensus_queue.cc:260] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } } peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } }
I20260806 11:47:09.600046 4788 tablet_bootstrap.cc:492] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: No bootstrap required, opened a new log
I20260806 11:47:09.600359 4788 ts_tablet_manager.cc:1397] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260806 11:47:09.601114 4787 ts_tablet_manager.cc:1428] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 11:47:09.602082 4789 raft_consensus.cc:348] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } } peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } }
I20260806 11:47:09.602485 4789 raft_consensus.cc:374] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:09.602571 4789 raft_consensus.cc:729] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4ad9e1f159423bb287646159adc19a, State: Initialized, Role: FOLLOWER
I20260806 11:47:09.602604 4375 heartbeater.cc:503] Master 127.26.172.254:43861 was elected leader, sending a full tablet report...
I20260806 11:47:09.603211 4789 consensus_queue.cc:260] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } } peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } }
I20260806 11:47:09.604812 4789 ts_tablet_manager.cc:1428] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
W20260806 11:47:09.606457 4378 tablet.cc:2369] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:47:09.606424 4788 raft_consensus.cc:348] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } } peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } }
I20260806 11:47:09.606889 4788 raft_consensus.cc:374] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:09.606956 4788 raft_consensus.cc:729] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f09eefa997904f9ca9192c8deaa28ce2, State: Initialized, Role: FOLLOWER
I20260806 11:47:09.607522 4742 heartbeater.cc:503] Master 127.26.172.254:43861 was elected leader, sending a full tablet report...
I20260806 11:47:09.607622 4788 consensus_queue.cc:260] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } } peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } }
I20260806 11:47:09.609668 4788 ts_tablet_manager.cc:1428] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260806 11:47:09.613250 4559 heartbeater.cc:503] Master 127.26.172.254:43861 was elected leader, sending a full tablet report...
I20260806 11:47:09.616747 4797 raft_consensus.cc:482] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:47:09.617090 4797 raft_consensus.cc:504] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } } peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } }
I20260806 11:47:09.618798 4797 leader_election.cc:288] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b4ad9e1f159423bb287646159adc19a (127.26.172.195:45327), 5e03c88772984603871093691a7dcfb7 (127.26.172.193:41227)
I20260806 11:47:09.623775 4565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.619156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:45327 (local address 127.26.172.194:33265)
0806 11:47:09.619457 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.619479 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.619619 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.619946 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.619951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.619978 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:09.620120 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.620126 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.621007 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.621013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.622060 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.622075 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.622868 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.622872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.623275 (+ 403us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.623297 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.623503 (+ 206us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.623624 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":43,"spinlock_wait_cycles":15872}
I20260806 11:47:09.623775 4783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.619231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:33265 (local address 127.26.172.195:45327)
0806 11:47:09.619479 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.619486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.619556 (+ 70us) server_negotiation.cc:407] Connection header received
0806 11:47:09.619755 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.619758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.619804 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.619926 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:09.620245 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.620881 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.622244 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.622689 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.622858 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.623145 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.623519 (+ 374us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.623610 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 11:47:09.624790 4679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a27420fc4c724a478bd3b8466666509f" candidate_uuid: "f09eefa997904f9ca9192c8deaa28ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4ad9e1f159423bb287646159adc19a" is_pre_election: true
I20260806 11:47:09.625236 4679 raft_consensus.cc:2454] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f09eefa997904f9ca9192c8deaa28ce2 in term 0.
I20260806 11:47:09.625864 4564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.619274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:41227 (local address 127.26.172.194:54863)
0806 11:47:09.619457 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:09.619479 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:09.619619 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:09.621146 (+ 1527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:09.621150 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:09.621175 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:09.621339 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.621346 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.622679 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.622686 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.623963 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:09.623983 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.625176 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.625180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:09.625318 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.625386 (+ 68us) client_negotiation.cc:769] Sending connection context
0806 11:47:09.625516 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 11:47:09.625652 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"mutex_wait_us":1,"spinlock_wait_cycles":16256}
I20260806 11:47:09.625864 4786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.619851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:54863 (local address 127.26.172.193:41227)
0806 11:47:09.620042 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.620047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.620063 (+ 16us) server_negotiation.cc:407] Connection header received
0806 11:47:09.620361 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.620367 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.620745 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.621100 (+ 355us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:09.621814 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.622508 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.624176 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.624823 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.625001 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.625063 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.625556 (+ 493us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.625698 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 11:47:09.626026 4411 leader_election.cc:302] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4ad9e1f159423bb287646159adc19a, f09eefa997904f9ca9192c8deaa28ce2; no voters:
I20260806 11:47:09.626453 4797 raft_consensus.cc:2781] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:47:09.626627 4797 raft_consensus.cc:482] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:47:09.626667 4797 raft_consensus.cc:3037] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:09.627065 4314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a27420fc4c724a478bd3b8466666509f" candidate_uuid: "f09eefa997904f9ca9192c8deaa28ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e03c88772984603871093691a7dcfb7" is_pre_election: true
I20260806 11:47:09.627532 4314 raft_consensus.cc:2454] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f09eefa997904f9ca9192c8deaa28ce2 in term 0.
I20260806 11:47:09.628742 4797 raft_consensus.cc:504] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } } peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } }
I20260806 11:47:09.629357 4797 leader_election.cc:288] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [CANDIDATE]: Term 1 election: Requested vote from peers 0b4ad9e1f159423bb287646159adc19a (127.26.172.195:45327), 5e03c88772984603871093691a7dcfb7 (127.26.172.193:41227)
I20260806 11:47:09.630069 4679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a27420fc4c724a478bd3b8466666509f" candidate_uuid: "f09eefa997904f9ca9192c8deaa28ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4ad9e1f159423bb287646159adc19a"
I20260806 11:47:09.630100 4314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a27420fc4c724a478bd3b8466666509f" candidate_uuid: "f09eefa997904f9ca9192c8deaa28ce2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e03c88772984603871093691a7dcfb7"
I20260806 11:47:09.630286 4679 raft_consensus.cc:3037] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:09.630292 4314 raft_consensus.cc:3037] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:09.632552 4679 raft_consensus.cc:2454] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f09eefa997904f9ca9192c8deaa28ce2 in term 1.
I20260806 11:47:09.632552 4314 raft_consensus.cc:2454] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f09eefa997904f9ca9192c8deaa28ce2 in term 1.
I20260806 11:47:09.633144 4412 leader_election.cc:302] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0b4ad9e1f159423bb287646159adc19a, 5e03c88772984603871093691a7dcfb7, f09eefa997904f9ca9192c8deaa28ce2; no voters:
I20260806 11:47:09.633504 4797 raft_consensus.cc:2781] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:09.633780 4797 raft_consensus.cc:686] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 1 LEADER]: Becoming Leader. State: Replica: f09eefa997904f9ca9192c8deaa28ce2, State: Running, Role: LEADER
I20260806 11:47:09.634250 4797 consensus_queue.cc:237] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } } peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } }
I20260806 11:47:09.638969 3054 catalog_manager.cc:5495] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f09eefa997904f9ca9192c8deaa28ce2 (127.26.172.194). New cstate: current_term: 1 leader_uuid: "f09eefa997904f9ca9192c8deaa28ce2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } health_report { overall_health: UNKNOWN } } }
I20260806 11:47:09.660341 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.654162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60940 (local address 127.26.172.194:34161)
0806 11:47:09.654427 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.654432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.654519 (+ 87us) server_negotiation.cc:407] Connection header received
0806 11:47:09.654805 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.654808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.655216 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.655453 (+ 237us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:47:09.655903 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.656561 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.657629 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.657895 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.658057 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.658920 (+ 863us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:47:09.659622 (+ 702us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:47:09.659761 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.659965 (+ 204us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.660062 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260806 11:47:09.669771 4314 raft_consensus.cc:1261] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7 [term 1 FOLLOWER]: Refusing update from remote peer f09eefa997904f9ca9192c8deaa28ce2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:09.670326 4679 raft_consensus.cc:1261] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a [term 1 FOLLOWER]: Refusing update from remote peer f09eefa997904f9ca9192c8deaa28ce2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:09.671504 4798 consensus_queue.cc:1035] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:09.672061 4797 consensus_queue.cc:1035] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 11:47:09.676755 4563 tablet.cc:2369] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:47:09.682922 4804 mvcc.cc:205] Tried to move back new op lower bound from 7315524934317096960 to 7315524934185512960. Current Snapshot: MvccSnapshot[applied={T|T < 7315524934317096960}]
I20260806 11:47:09.691905 4805 mvcc.cc:205] Tried to move back new op lower bound from 7315524934317096960 to 7315524934185512960. Current Snapshot: MvccSnapshot[applied={T|T < 7315524934317096960}]
I20260806 11:47:09.700265 3053 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:09.700536 3053 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:09.707334 3053 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c964b9ce3b3c4819b7094acd447672f0: Sending DeleteTablet for 3 replicas of tablet a27420fc4c724a478bd3b8466666509f
I20260806 11:47:09.708509 4469 tablet_service.cc:1514] Processing DeleteTablet for tablet a27420fc4c724a478bd3b8466666509f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:09 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:60934
I20260806 11:47:09.708679 4654 tablet_service.cc:1514] Processing DeleteTablet for tablet a27420fc4c724a478bd3b8466666509f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:09 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:48566
I20260806 11:47:09.709482 4815 tablet_replica.cc:330] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: stopping tablet replica
I20260806 11:47:09.710007 4815 raft_consensus.cc:2229] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:09.710129 4290 tablet_service.cc:1514] Processing DeleteTablet for tablet a27420fc4c724a478bd3b8466666509f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:09 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:34154
I20260806 11:47:09.710564 4815 raft_consensus.cc:2258] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:09.710767 4814 tablet_replica.cc:330] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: stopping tablet replica
I20260806 11:47:09.711223 4818 tablet_replica.cc:330] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: stopping tablet replica
I20260806 11:47:09.711459 4814 raft_consensus.cc:2229] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:47:09.712167 4814 raft_consensus.cc:2258] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:09.713480 4815 ts_tablet_manager.cc:1905] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:09.714711 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 3014
I20260806 11:47:09.725975 4815 ts_tablet_manager.cc:1918] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:09.726167 4815 log.cc:1196] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/a27420fc4c724a478bd3b8466666509f
I20260806 11:47:09.726605 4815 ts_tablet_manager.cc:1939] T a27420fc4c724a478bd3b8466666509f P 0b4ad9e1f159423bb287646159adc19a: Deleting consensus metadata
I20260806 11:47:09.728734 4818 raft_consensus.cc:2229] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:09.729286 4818 raft_consensus.cc:2258] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:09.729689 4814 ts_tablet_manager.cc:1905] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:09.734469 4814 ts_tablet_manager.cc:1918] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:09.734777 4814 log.cc:1196] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/a27420fc4c724a478bd3b8466666509f
I20260806 11:47:09.735816 4814 ts_tablet_manager.cc:1939] T a27420fc4c724a478bd3b8466666509f P f09eefa997904f9ca9192c8deaa28ce2: Deleting consensus metadata
I20260806 11:47:09.737612 4818 ts_tablet_manager.cc:1905] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 11:47:09.739063 4594 connection.cc:535] server connection from 127.0.0.1:48566 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 11:47:09.739566 4410 connection.cc:535] server connection from 127.0.0.1:60934 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 11:47:09.741448 4818 ts_tablet_manager.cc:1918] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:09.741585 4818 log.cc:1196] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/a27420fc4c724a478bd3b8466666509f
I20260806 11:47:09.742002 4818 ts_tablet_manager.cc:1939] T a27420fc4c724a478bd3b8466666509f P 5e03c88772984603871093691a7dcfb7: Deleting consensus metadata
I20260806 11:47:09.743487 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.713593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42392 (local address 127.26.172.253:39155)
0806 11:47:09.715312 (+ 1719us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.715319 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.715340 (+ 21us) server_negotiation.cc:407] Connection header received
0806 11:47:09.715412 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.715418 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.715504 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.715612 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.731094 (+ 15482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.732040 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.733753 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.734240 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.734357 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.738443 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.738449 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.738452 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.738501 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.740738 (+ 2237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.741478 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.741483 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.741486 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.741602 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.741983 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.741987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.741989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.742456 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.742583 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.743055 (+ 472us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.743273 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1599}
W20260806 11:47:09.743572 4224 connection.cc:441] server connection from 127.0.0.1:34154 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34154 (request call id 1) could send its response
I20260806 11:47:09.756695 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.745425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42402 (local address 127.26.172.253:39155)
0806 11:47:09.745561 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.745565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.745745 (+ 180us) server_negotiation.cc:407] Connection header received
0806 11:47:09.745977 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.745981 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.746034 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.746088 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.747243 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.747998 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.749171 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.749500 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.749593 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.752014 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.752018 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.752021 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.752047 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.754275 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.755014 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.755018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.755020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.755114 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.755503 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.755508 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.755512 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.755783 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.755921 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.756343 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.756485 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 11:47:09.758056 4387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.745947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55166 (local address 127.26.172.252:36449)
0806 11:47:09.746079 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.746083 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.746748 (+ 665us) server_negotiation.cc:407] Connection header received
0806 11:47:09.746998 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.747001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.747059 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.747111 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.748146 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.748998 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.750349 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.750722 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.751081 (+ 359us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.753312 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.753317 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.753319 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.753356 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.756022 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.756532 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.756536 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.756537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.756622 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.756976 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.756980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.756981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.757224 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.757347 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.757722 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.757871 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 11:47:09.758527 4758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:09.713710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55152 (local address 127.26.172.252:36449)
0806 11:47:09.713906 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:09.713913 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:09.744721 (+ 30808us) server_negotiation.cc:407] Connection header received
0806 11:47:09.744961 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:09.744965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:09.745041 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:09.745100 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:09.746530 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.747414 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.748576 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:09.748971 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:09.749071 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:09.751555 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:09.751562 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:09.751568 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:09.751614 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:09.755454 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.756205 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.756208 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.756210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.756316 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:09.756628 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:09.756632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:09.756634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:09.756934 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:09.757817 (+ 883us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:09.757896 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 11:47:09.758046 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 11:47:10.688920 4828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:10.688244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.195:53175)
0806 11:47:10.688640 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:10.688786 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":91,"threads_started":1}
W20260806 11:47:10.689435 4742 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:43861 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
I20260806 11:47:10.692129 4829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:10.691548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.194:54959)
0806 11:47:10.691908 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:10.692020 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":109,"threads_started":1}
W20260806 11:47:10.692543 4559 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:43861 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
I20260806 11:47:10.696290 4830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:10.695608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.193:37023)
0806 11:47:10.696003 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:10.696156 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":126,"threads_started":1}
W20260806 11:47:10.696821 4375 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:43861 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
I20260806 11:47:11.207681 4833 raft_consensus.cc:482] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c964b9ce3b3c4819b7094acd447672f0)
I20260806 11:47:11.208056 4833 raft_consensus.cc:504] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } }
I20260806 11:47:11.208877 4834 raft_consensus.cc:482] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c964b9ce3b3c4819b7094acd447672f0)
I20260806 11:47:11.209188 4834 raft_consensus.cc:504] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } }
I20260806 11:47:11.209626 4833 leader_election.cc:288] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c964b9ce3b3c4819b7094acd447672f0 (127.26.172.254:43861), f98f52fcd6164bca9e52b20f50e562da (127.26.172.253:39155)
I20260806 11:47:11.210551 4835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.209889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:46324)
0806 11:47:11.210291 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.210401 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":144,"threads_started":1}
I20260806 11:47:11.210634 4834 leader_election.cc:288] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c964b9ce3b3c4819b7094acd447672f0 (127.26.172.254:43861), b898a5bd1948400f9a2398176403abfa (127.26.172.252:36449)
W20260806 11:47:11.211172 4115 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
I20260806 11:47:11.211906 4838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.210784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:46330)
0806 11:47:11.211684 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.211776 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":292,"threads_started":1}
W20260806 11:47:11.212127 3848 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
I20260806 11:47:11.212348 4835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.212070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:46340)
0806 11:47:11.212216 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.212272 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260806 11:47:11.212491 4115 leader_election.cc:334] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c964b9ce3b3c4819b7094acd447672f0 (127.26.172.254:43861): Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
I20260806 11:47:11.213481 4838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.213221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:46354)
0806 11:47:11.213340 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.213409 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 11:47:11.213619 3848 leader_election.cc:334] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c964b9ce3b3c4819b7094acd447672f0 (127.26.172.254:43861): Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
I20260806 11:47:11.215925 4837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.210339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42412 (local address 127.26.172.253:39155)
0806 11:47:11.210959 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:11.210966 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:11.210988 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:47:11.211321 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:11.211324 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:11.211378 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:11.211584 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:11.212001 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.212852 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.214529 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.215184 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.215320 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.215371 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:11.215726 (+ 355us) server_negotiation.cc:299] Negotiation successful
0806 11:47:11.215800 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":457,"thread_start_us":108,"threads_started":1}
I20260806 11:47:11.215930 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.210126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:39155 (local address 127.0.0.1:42412)
0806 11:47:11.210477 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.210491 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:11.211149 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:11.211730 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:11.211732 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:11.211749 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:11.211837 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.211841 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.213004 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.213008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.214337 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.214348 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.215459 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.215464 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.215554 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.215586 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 11:47:11.215693 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 11:47:11.215784 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":1,"thread_start_us":101,"threads_started":1}
I20260806 11:47:11.216702 3884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b898a5bd1948400f9a2398176403abfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f98f52fcd6164bca9e52b20f50e562da" is_pre_election: true
I20260806 11:47:11.217073 3884 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b898a5bd1948400f9a2398176403abfa in term 1.
I20260806 11:47:11.217546 4839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.210922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36449 (local address 127.0.0.1:55172)
0806 11:47:11.211446 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.211460 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:11.212615 (+ 1155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:11.213664 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:11.213667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:11.213689 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:11.213784 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.213790 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.214735 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.214739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.215972 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.215985 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.217037 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.217041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.217151 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.217169 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 11:47:11.217267 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 11:47:11.217357 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":82,"threads_started":1}
I20260806 11:47:11.217664 4841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.211082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55172 (local address 127.26.172.252:36449)
0806 11:47:11.211334 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:11.211339 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:11.211565 (+ 226us) server_negotiation.cc:407] Connection header received
0806 11:47:11.212795 (+ 1230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:11.212798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:11.212858 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:11.212987 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:11.213925 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.214626 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.216162 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.216777 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.216859 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.216900 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:11.217322 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 11:47:11.217453 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":155,"thread_start_us":58,"threads_started":1}
I20260806 11:47:11.217661 4116 leader_election.cc:302] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b898a5bd1948400f9a2398176403abfa, f98f52fcd6164bca9e52b20f50e562da; no voters: c964b9ce3b3c4819b7094acd447672f0
I20260806 11:47:11.218039 4833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 11:47:11.218113 4833 raft_consensus.cc:482] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 FOLLOWER]: Starting leader election (detected failure of leader c964b9ce3b3c4819b7094acd447672f0)
I20260806 11:47:11.218173 4833 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 1 FOLLOWER]: Advancing to term 2
I20260806 11:47:11.218712 4139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f98f52fcd6164bca9e52b20f50e562da" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b898a5bd1948400f9a2398176403abfa" is_pre_election: true
I20260806 11:47:11.219878 4833 raft_consensus.cc:504] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } }
I20260806 11:47:11.220271 4139 raft_consensus.cc:2379] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f98f52fcd6164bca9e52b20f50e562da in current term 2: Already voted for candidate b898a5bd1948400f9a2398176403abfa in this term.
I20260806 11:47:11.220484 4833 leader_election.cc:288] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [CANDIDATE]: Term 2 election: Requested vote from peers c964b9ce3b3c4819b7094acd447672f0 (127.26.172.254:43861), f98f52fcd6164bca9e52b20f50e562da (127.26.172.253:39155)
I20260806 11:47:11.221028 3884 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b898a5bd1948400f9a2398176403abfa" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f98f52fcd6164bca9e52b20f50e562da"
I20260806 11:47:11.221239 3884 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 1 FOLLOWER]: Advancing to term 2
I20260806 11:47:11.221530 3850 leader_election.cc:302] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f98f52fcd6164bca9e52b20f50e562da; no voters: b898a5bd1948400f9a2398176403abfa, c964b9ce3b3c4819b7094acd447672f0
I20260806 11:47:11.222441 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.220709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:46364)
0806 11:47:11.222225 (+ 1516us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.222352 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260806 11:47:11.223546 3884 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b898a5bd1948400f9a2398176403abfa in term 2.
I20260806 11:47:11.223698 4834 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:47:11.223775 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.223412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:46372)
0806 11:47:11.223618 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.223688 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260806 11:47:11.224004 4115 leader_election.cc:334] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c964b9ce3b3c4819b7094acd447672f0 (127.26.172.254:43861): Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
I20260806 11:47:11.224206 4115 leader_election.cc:302] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b898a5bd1948400f9a2398176403abfa, f98f52fcd6164bca9e52b20f50e562da; no voters: c964b9ce3b3c4819b7094acd447672f0
I20260806 11:47:11.224411 4833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 2 FOLLOWER]: Leader election won for term 2
I20260806 11:47:11.224707 4833 raft_consensus.cc:686] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [term 2 LEADER]: Becoming Leader. State: Replica: b898a5bd1948400f9a2398176403abfa, State: Running, Role: LEADER
I20260806 11:47:11.225063 4833 consensus_queue.cc:237] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } }
I20260806 11:47:11.226666 4845 sys_catalog.cc:455] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader b898a5bd1948400f9a2398176403abfa. Latest consensus state: current_term: 2 leader_uuid: "b898a5bd1948400f9a2398176403abfa" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:11.226914 4845 sys_catalog.cc:458] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:11.227593 4849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:11.231431 4849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:11.232041 4849 catalog_manager.cc:1259] Loaded cluster ID: 209097add5a84419abc13b8342ac1d7c
I20260806 11:47:11.232097 4849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:11.232803 4849 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:11.233202 4849 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Loaded TSK: 0
I20260806 11:47:11.234099 4849 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:47:11.257614 4132 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55166:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:47:11.262319 4132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:47:11.268006 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.267570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:46392)
0806 11:47:11.267785 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.267874 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260806 11:47:11.268016 3884 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [term 2 FOLLOWER]: Refusing update from remote peer b898a5bd1948400f9a2398176403abfa: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260806 11:47:11.269060 4845 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260806 11:47:11.269230 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.268830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.0.0.1:46396)
0806 11:47:11.269085 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.269159 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
W20260806 11:47:11.269418 4115 consensus_peers.cc:487] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa -> Peer c964b9ce3b3c4819b7094acd447672f0 (127.26.172.254:43861): Couldn't send request to peer c964b9ce3b3c4819b7094acd447672f0. Status: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 11:47:11.271617 4834 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: SysCatalogTable state changed. Reason: New leader b898a5bd1948400f9a2398176403abfa. Latest consensus state: current_term: 2 leader_uuid: "b898a5bd1948400f9a2398176403abfa" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:11.271791 4834 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:47:11.273334 4833 sys_catalog.cc:455] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "b898a5bd1948400f9a2398176403abfa" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:11.273487 4833 sys_catalog.cc:458] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:11.273984 4834 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "b898a5bd1948400f9a2398176403abfa" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "c964b9ce3b3c4819b7094acd447672f0" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 43861 } } peers { permanent_uuid: "f98f52fcd6164bca9e52b20f50e562da" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 39155 } attrs { promote: false } } peers { permanent_uuid: "b898a5bd1948400f9a2398176403abfa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36449 } attrs { promote: false } } }
I20260806 11:47:11.274121 4834 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98f52fcd6164bca9e52b20f50e562da [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:47:11.288548 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.283165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:41227 (local address 127.0.0.1:34166)
0806 11:47:11.283317 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.283335 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:11.283441 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:11.284050 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:11.284056 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:11.284075 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:11.284213 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.284220 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.285844 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.285850 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.287159 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.287172 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.288057 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.288061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.288166 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.288209 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 11:47:11.288260 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 11:47:11.288361 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":31}
I20260806 11:47:11.288548 4835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.283721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:45327 (local address 127.0.0.1:48570)
0806 11:47:11.284000 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.284016 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:11.284087 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:11.284696 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:11.284699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:11.284719 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:11.284864 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.284871 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.285877 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.285881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.287060 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.287071 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.288225 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.288229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.288317 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.288335 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 11:47:11.288377 (+ 42us) client_negotiation.cc:240] Negotiation successful
0806 11:47:11.288439 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":48}
I20260806 11:47:11.289111 4862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.283796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:34161 (local address 127.0.0.1:60952)
0806 11:47:11.284521 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.284539 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:11.284684 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:11.285147 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:11.285149 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:11.285166 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:11.285246 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.285252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.286325 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.286329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.287459 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.287467 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.288561 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.288565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.288638 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.288697 (+ 59us) client_negotiation.cc:769] Sending connection context
0806 11:47:11.288778 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 11:47:11.288888 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":145,"threads_started":1}
I20260806 11:47:11.289310 4865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.284049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48570 (local address 127.26.172.195:45327)
0806 11:47:11.284364 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:11.284370 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:11.284386 (+ 16us) server_negotiation.cc:407] Connection header received
0806 11:47:11.284442 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:11.284445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:11.284498 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:11.284600 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:11.285028 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.285727 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.287205 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.287898 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.288952 (+ 1054us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.289028 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:11.289073 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 11:47:11.289161 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":92,"threads_started":1}
I20260806 11:47:11.289454 4861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.283355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34166 (local address 127.26.172.193:41227)
0806 11:47:11.283734 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:11.283738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:11.283780 (+ 42us) server_negotiation.cc:407] Connection header received
0806 11:47:11.283844 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:11.283847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:11.283904 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:11.284781 (+ 877us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:11.284901 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.285689 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.287285 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.287895 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.289134 (+ 1239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.289186 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:11.289221 (+ 35us) server_negotiation.cc:299] Negotiation successful
0806 11:47:11.289297 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":180,"threads_started":1}
I20260806 11:47:11.289628 4866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.284193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60952 (local address 127.26.172.194:34161)
0806 11:47:11.284511 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:11.284517 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:11.284774 (+ 257us) server_negotiation.cc:407] Connection header received
0806 11:47:11.284846 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:11.284849 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:11.284912 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:11.285006 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:11.285422 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.286176 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.287614 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.288282 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.288426 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.288506 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:11.289311 (+ 805us) server_negotiation.cc:299] Negotiation successful
0806 11:47:11.289430 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":117,"threads_started":1}
I20260806 11:47:11.289983 4654 tablet_service.cc:1467] Processing CreateTablet for tablet c7d142367dca4988a00c69956b07c95b (DEFAULT_TABLE table=test-table [id=8946fd288fae4c959a8509ed0a6748b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:11.289983 4290 tablet_service.cc:1467] Processing CreateTablet for tablet c7d142367dca4988a00c69956b07c95b (DEFAULT_TABLE table=test-table [id=8946fd288fae4c959a8509ed0a6748b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:11.290321 4290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7d142367dca4988a00c69956b07c95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:11.290321 4654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7d142367dca4988a00c69956b07c95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:11.290318 4469 tablet_service.cc:1467] Processing CreateTablet for tablet c7d142367dca4988a00c69956b07c95b (DEFAULT_TABLE table=test-table [id=8946fd288fae4c959a8509ed0a6748b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:11.290720 4469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7d142367dca4988a00c69956b07c95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:11.293737 4871 tablet_bootstrap.cc:492] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2: Bootstrap starting.
I20260806 11:47:11.294536 4868 tablet_bootstrap.cc:492] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7: Bootstrap starting.
I20260806 11:47:11.295061 4870 tablet_bootstrap.cc:492] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: Bootstrap starting.
I20260806 11:47:11.295578 4871 tablet_bootstrap.cc:654] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:11.295998 4868 tablet_bootstrap.cc:654] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:11.296192 4870 tablet_bootstrap.cc:654] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:11.297407 4871 tablet_bootstrap.cc:492] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2: No bootstrap required, opened a new log
I20260806 11:47:11.297540 4871 ts_tablet_manager.cc:1397] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:11.297607 4870 tablet_bootstrap.cc:492] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: No bootstrap required, opened a new log
I20260806 11:47:11.297698 4870 ts_tablet_manager.cc:1397] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 11:47:11.297802 4868 tablet_bootstrap.cc:492] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7: No bootstrap required, opened a new log
I20260806 11:47:11.297957 4868 ts_tablet_manager.cc:1397] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:11.298064 4871 raft_consensus.cc:348] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } } peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } }
I20260806 11:47:11.298234 4871 raft_consensus.cc:374] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:11.298170 4870 raft_consensus.cc:348] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } } peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } }
I20260806 11:47:11.298305 4870 raft_consensus.cc:374] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:11.298300 4871 raft_consensus.cc:729] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f09eefa997904f9ca9192c8deaa28ce2, State: Initialized, Role: FOLLOWER
I20260806 11:47:11.298341 4870 raft_consensus.cc:729] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b4ad9e1f159423bb287646159adc19a, State: Initialized, Role: FOLLOWER
I20260806 11:47:11.298511 4871 consensus_queue.cc:260] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } } peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } }
I20260806 11:47:11.298511 4870 consensus_queue.cc:260] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } } peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } }
I20260806 11:47:11.298638 4868 raft_consensus.cc:348] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } } peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } }
I20260806 11:47:11.298807 4868 raft_consensus.cc:374] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:11.298894 4868 raft_consensus.cc:729] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e03c88772984603871093691a7dcfb7, State: Initialized, Role: FOLLOWER
I20260806 11:47:11.299074 4870 ts_tablet_manager.cc:1428] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 11:47:11.299074 4871 ts_tablet_manager.cc:1428] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 11:47:11.299121 4868 consensus_queue.cc:260] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } } peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } }
I20260806 11:47:11.301298 4880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.300587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.195:48653)
0806 11:47:11.301083 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.301147 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":125,"threads_started":1}
I20260806 11:47:11.303117 4880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.302777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.195:46927)
0806 11:47:11.303009 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.303057 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260806 11:47:11.303757 4882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.303199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.194:50595)
0806 11:47:11.303583 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.303642 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":160,"threads_started":1}
I20260806 11:47:11.303788 4558 heartbeater.cc:503] Master 127.26.172.252:36449 was elected leader, sending a full tablet report...
I20260806 11:47:11.304675 4868 ts_tablet_manager.cc:1428] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260806 11:47:11.304929 4741 heartbeater.cc:503] Master 127.26.172.252:36449 was elected leader, sending a full tablet report...
I20260806 11:47:11.304944 4374 heartbeater.cc:503] Master 127.26.172.252:36449 was elected leader, sending a full tablet report...
I20260806 11:47:11.305366 4881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.301079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.193:42467)
0806 11:47:11.305114 (+ 4035us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.305201 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3943,"thread_start_us":154,"threads_started":1}
I20260806 11:47:11.307138 4882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.304463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.194:36465)
0806 11:47:11.304791 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.307009 (+ 2218us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":129,"threads_started":1}
I20260806 11:47:11.307410 4881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.306751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.193:49901)
0806 11:47:11.307242 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.307312 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383}
I20260806 11:47:11.434736 4878 raft_consensus.cc:482] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:47:11.434964 4878 raft_consensus.cc:504] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } } peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } }
I20260806 11:47:11.436259 4878 leader_election.cc:288] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f09eefa997904f9ca9192c8deaa28ce2 (127.26.172.194:34161), 0b4ad9e1f159423bb287646159adc19a (127.26.172.195:45327)
I20260806 11:47:11.441370 4881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.436847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:45327 (local address 127.26.172.193:53773)
0806 11:47:11.437206 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.437228 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:11.437408 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:11.437744 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:11.437747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:11.437771 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:11.437985 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.437994 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.438910 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.438914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.440011 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.440023 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.440793 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.440797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.440930 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.440956 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 11:47:11.441044 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 11:47:11.441145 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":31}
I20260806 11:47:11.441433 4865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.437066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:53773 (local address 127.26.172.195:45327)
0806 11:47:11.437209 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:11.437214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:11.437371 (+ 157us) server_negotiation.cc:407] Connection header received
0806 11:47:11.437520 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:11.437526 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:11.437616 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:11.437703 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:11.438132 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.438742 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.440157 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.440674 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.440793 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.440861 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:11.441124 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 11:47:11.441256 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 11:47:11.441514 4866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.436908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:36051 (local address 127.26.172.194:34161)
0806 11:47:11.437060 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:11.437065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:11.437569 (+ 504us) server_negotiation.cc:407] Connection header received
0806 11:47:11.437768 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:11.437771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:11.437833 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:11.437922 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:11.438302 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.438997 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.440226 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.440697 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.440840 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.440922 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:11.441231 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 11:47:11.441367 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 11:47:11.442044 4679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7d142367dca4988a00c69956b07c95b" candidate_uuid: "5e03c88772984603871093691a7dcfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4ad9e1f159423bb287646159adc19a" is_pre_election: true
I20260806 11:47:11.442199 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.436847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:34161 (local address 127.26.172.193:36051)
0806 11:47:11.437412 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.437429 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:11.437579 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:11.437962 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:11.437966 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:11.437989 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:11.438150 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.438159 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.439130 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.439133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.440042 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:11.440051 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.440950 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.440954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:11.441053 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.441071 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 11:47:11.441968 (+ 897us) client_negotiation.cc:240] Negotiation successful
0806 11:47:11.442046 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"mutex_wait_us":69,"thread_start_us":217,"threads_started":1}
I20260806 11:47:11.442273 4679 raft_consensus.cc:2454] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e03c88772984603871093691a7dcfb7 in term 0.
I20260806 11:47:11.442787 4224 leader_election.cc:302] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b4ad9e1f159423bb287646159adc19a, 5e03c88772984603871093691a7dcfb7; no voters:
I20260806 11:47:11.443157 4878 raft_consensus.cc:2781] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:47:11.443233 4878 raft_consensus.cc:482] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:47:11.443264 4878 raft_consensus.cc:3037] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:11.443094 4498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7d142367dca4988a00c69956b07c95b" candidate_uuid: "5e03c88772984603871093691a7dcfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f09eefa997904f9ca9192c8deaa28ce2" is_pre_election: true
I20260806 11:47:11.443491 4498 raft_consensus.cc:2454] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e03c88772984603871093691a7dcfb7 in term 0.
I20260806 11:47:11.444579 4878 raft_consensus.cc:504] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } } peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } }
I20260806 11:47:11.445006 4878 leader_election.cc:288] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [CANDIDATE]: Term 1 election: Requested vote from peers f09eefa997904f9ca9192c8deaa28ce2 (127.26.172.194:34161), 0b4ad9e1f159423bb287646159adc19a (127.26.172.195:45327)
I20260806 11:47:11.445508 4498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7d142367dca4988a00c69956b07c95b" candidate_uuid: "5e03c88772984603871093691a7dcfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f09eefa997904f9ca9192c8deaa28ce2"
I20260806 11:47:11.445472 4679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7d142367dca4988a00c69956b07c95b" candidate_uuid: "5e03c88772984603871093691a7dcfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b4ad9e1f159423bb287646159adc19a"
I20260806 11:47:11.445667 4679 raft_consensus.cc:3037] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:11.445667 4498 raft_consensus.cc:3037] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:11.447290 4679 raft_consensus.cc:2454] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e03c88772984603871093691a7dcfb7 in term 1.
I20260806 11:47:11.447331 4498 raft_consensus.cc:2454] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e03c88772984603871093691a7dcfb7 in term 1.
I20260806 11:47:11.447726 4227 leader_election.cc:302] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e03c88772984603871093691a7dcfb7, f09eefa997904f9ca9192c8deaa28ce2; no voters:
I20260806 11:47:11.447984 4878 raft_consensus.cc:2781] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:11.448251 4878 raft_consensus.cc:686] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 1 LEADER]: Becoming Leader. State: Replica: 5e03c88772984603871093691a7dcfb7, State: Running, Role: LEADER
I20260806 11:47:11.448573 4878 consensus_queue.cc:237] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } } peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } }
I20260806 11:47:11.449148 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.448850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.193:37899)
0806 11:47:11.449001 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.449073 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 11:47:11.451589 4132 catalog_manager.cc:5495] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e03c88772984603871093691a7dcfb7 (127.26.172.193). New cstate: current_term: 1 leader_uuid: "5e03c88772984603871093691a7dcfb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e03c88772984603871093691a7dcfb7" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 } health_report { overall_health: UNKNOWN } } }
I20260806 11:47:11.492023 4861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.486498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34174 (local address 127.26.172.193:41227)
0806 11:47:11.486711 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:11.486716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:11.486735 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:47:11.486939 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:11.486942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:11.487061 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:11.487248 (+ 187us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:47:11.487532 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.488361 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.489499 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:11.489866 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:11.490008 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:11.490428 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:47:11.491314 (+ 886us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:47:11.491450 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:11.491591 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 11:47:11.491793 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260806 11:47:11.492648 4747 tablet.cc:2369] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:47:11.496690 4679 raft_consensus.cc:1261] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a [term 1 FOLLOWER]: Refusing update from remote peer 5e03c88772984603871093691a7dcfb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:11.496904 4498 raft_consensus.cc:1261] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2 [term 1 FOLLOWER]: Refusing update from remote peer 5e03c88772984603871093691a7dcfb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:11.497540 4878 consensus_queue.cc:1035] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b4ad9e1f159423bb287646159adc19a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 45327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:11.497870 4886 consensus_queue.cc:1035] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f09eefa997904f9ca9192c8deaa28ce2" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:11.500437 4880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.500048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.195:57469)
0806 11:47:11.500254 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.500332 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260806 11:47:11.504604 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.504225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.193:51461)
0806 11:47:11.504415 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.504488 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260806 11:47:11.507500 4884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.499858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.194:60679)
0806 11:47:11.500339 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.500420 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383}
I20260806 11:47:11.510442 4880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.510099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.195:50833)
0806 11:47:11.510264 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.510336 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 11:47:11.511498 4891 mvcc.cc:205] Tried to move back new op lower bound from 7315524941801365504 to 7315524941616934912. Current Snapshot: MvccSnapshot[applied={T|T < 7315524941801365504}]
I20260806 11:47:11.511658 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.510681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.193:45115)
0806 11:47:11.511496 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.511562 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":722}
I20260806 11:47:11.512532 4884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.510725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:43861 (local address 127.26.172.194:60377)
0806 11:47:11.512372 (+ 1647us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.512439 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:43861: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1552}
I20260806 11:47:11.517513 4132 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55166:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:11.517757 4132 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55166:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:11.523869 4132 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b898a5bd1948400f9a2398176403abfa: Sending DeleteTablet for 3 replicas of tablet c7d142367dca4988a00c69956b07c95b
I20260806 11:47:11.525275 4290 tablet_service.cc:1514] Processing DeleteTablet for tablet c7d142367dca4988a00c69956b07c95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:11 UTC) from {username='oryx', principal='oryx/127.26.172.252@KRBTEST.COM'} at 127.0.0.1:34166
I20260806 11:47:11.525328 4654 tablet_service.cc:1514] Processing DeleteTablet for tablet c7d142367dca4988a00c69956b07c95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:11 UTC) from {username='oryx', principal='oryx/127.26.172.252@KRBTEST.COM'} at 127.0.0.1:48570
I20260806 11:47:11.525871 4902 tablet_replica.cc:330] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7: stopping tablet replica
I20260806 11:47:11.526095 4902 raft_consensus.cc:2229] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:47:11.526373 4469 tablet_service.cc:1514] Processing DeleteTablet for tablet c7d142367dca4988a00c69956b07c95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:11 UTC) from {username='oryx', principal='oryx/127.26.172.252@KRBTEST.COM'} at 127.0.0.1:60952
I20260806 11:47:11.526561 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 4075
I20260806 11:47:11.526615 4902 raft_consensus.cc:2258] T c7d142367dca4988a00c69956b07c95b P 5e03c88772984603871093691a7dcfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:11.534282 4904 tablet_replica.cc:330] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2: stopping tablet replica
I20260806 11:47:11.534623 4904 raft_consensus.cc:2229] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:11.534938 4904 raft_consensus.cc:2258] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:11.536592 4904 ts_tablet_manager.cc:1905] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:11.537967 4903 tablet_replica.cc:330] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: stopping tablet replica
I20260806 11:47:11.538187 4903 raft_consensus.cc:2229] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:11.538414 4903 raft_consensus.cc:2258] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:11.539515 4903 ts_tablet_manager.cc:1905] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:11.541946 4904 ts_tablet_manager.cc:1918] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:11.542176 4903 ts_tablet_manager.cc:1918] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:11.542302 4903 log.cc:1196] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/c7d142367dca4988a00c69956b07c95b
I20260806 11:47:11.542109 4904 log.cc:1196] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/c7d142367dca4988a00c69956b07c95b
I20260806 11:47:11.542656 4903 ts_tablet_manager.cc:1939] T c7d142367dca4988a00c69956b07c95b P 0b4ad9e1f159423bb287646159adc19a: Deleting consensus metadata
I20260806 11:47:11.542938 4904 ts_tablet_manager.cc:1939] T c7d142367dca4988a00c69956b07c95b P f09eefa997904f9ca9192c8deaa28ce2: Deleting consensus metadata
I20260806 11:47:11.544528 4114 catalog_manager.cc:4841] TS 0b4ad9e1f159423bb287646159adc19a (127.26.172.195:45327): tablet c7d142367dca4988a00c69956b07c95b (table test-table [id=8946fd288fae4c959a8509ed0a6748b8]) successfully deleted
I20260806 11:47:11.544745 4116 catalog_manager.cc:4841] TS f09eefa997904f9ca9192c8deaa28ce2 (127.26.172.194:34161): tablet c7d142367dca4988a00c69956b07c95b (table test-table [id=8946fd288fae4c959a8509ed0a6748b8]) successfully deleted
I20260806 11:47:11.553215 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 4388
I20260806 11:47:11.555445 4862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.554902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:41227 (local address 127.0.0.1:34184)
0806 11:47:11.555213 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.555296 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:41227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175}
W20260806 11:47:11.555838 4115 catalog_manager.cc:4584] TS 5e03c88772984603871093691a7dcfb7 (127.26.172.193:41227): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c7d142367dca4988a00c69956b07c95b: Network error: Client connection negotiation failed: client connection to 127.26.172.193:41227: connect: Connection refused (error 111)
I20260806 11:47:11.571907 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 4569
I20260806 11:47:11.598134 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 3668
I20260806 11:47:11.616915 4862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.616512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:41227 (local address 127.0.0.1:34190)
0806 11:47:11.616683 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.616768 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:41227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 11:47:11.618788 4862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:11.618505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:41227 (local address 127.0.0.1:34194)
0806 11:47:11.618625 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:11.618689 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:41227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 11:47:11.621768 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 3813
2026-08-06T11:47:11Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6701 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:47:11 dist-test-slave-7z32 krb5kdc[4908](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:47:11 dist-test-slave-7z32 krb5kdc[4908](info): set up 2 sockets
Aug 06 11:47:11 dist-test-slave-7z32 krb5kdc[4908](info): commencing operation
krb5kdc: starting...
W20260806 11:47:12.969727 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:47:13 dist-test-slave-7z32 krb5kdc[4908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:47:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:13Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.254.keytab.
Entry for principal oryx/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.254.keytab.
I20260806 11:47:13.143011 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:44265
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.254.keytab
--principal=oryx/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:45047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:44265
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:13.277523 4923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:13.277860 4923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:13.277905 4923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:13.282375 4923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:13.282454 4923 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 11:47:13.282473 4923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:13.282492 4923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:13.282511 4923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:13.282528 4923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:13.288553 4923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:45047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:44265
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.254.keytab
--principal=oryx/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:44265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:13.289876 4923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:13.291211 4923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:13.301964 4930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:13.301970 4934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:13.302175 4931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:13.302139 4923 server_base.cc:1034] running on GCE node
I20260806 11:47:13.303189 4923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:13.304642 4923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:13.305868 4923 hybrid_clock.cc:648] HybridClock initialized: now 1786016833305822 us; error 71 us; skew 500 ppm
Aug 06 11:47:13 dist-test-slave-7z32 krb5kdc[4908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016833, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:13.309701 4923 init.cc:377] Logged in from keytab as oryx/127.26.172.254@KRBTEST.COM (short username oryx)
I20260806 11:47:13.311082 4923 webserver.cc:460] Webserver started at http://127.26.172.254:46777/ using document root <none> and password file <none>
I20260806 11:47:13.311772 4923 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:13.311856 4923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:13.312117 4923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:13.314533 4923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "bbd00b6d5923456aa28813483a686889"
format_stamp: "Formatted at 2026-08-06 11:47:13 on dist-test-slave-7z32"
server_key: "9b395a60df95b1c8af43520ba91f22ae"
server_key_iv: "027a7c18bbb87520c49c14ec6c1a8f0c"
server_key_version: "encryptionkey@0"
I20260806 11:47:13.315246 4923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "bbd00b6d5923456aa28813483a686889"
format_stamp: "Formatted at 2026-08-06 11:47:13 on dist-test-slave-7z32"
server_key: "9b395a60df95b1c8af43520ba91f22ae"
server_key_iv: "027a7c18bbb87520c49c14ec6c1a8f0c"
server_key_version: "encryptionkey@0"
I20260806 11:47:13.319918 4923 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:47:13.323185 4944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:13.325138 4923 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:47:13.325399 4923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "bbd00b6d5923456aa28813483a686889"
format_stamp: "Formatted at 2026-08-06 11:47:13 on dist-test-slave-7z32"
server_key: "9b395a60df95b1c8af43520ba91f22ae"
server_key_iv: "027a7c18bbb87520c49c14ec6c1a8f0c"
server_key_version: "encryptionkey@0"
I20260806 11:47:13.325556 4923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:13.336293 4923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:13.340430 4923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:13.340684 4923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:13.350313 4923 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:44265
I20260806 11:47:13.350426 5032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:44265 every 8 connection(s)
I20260806 11:47:13.351588 4923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:13.353292 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 4923
I20260806 11:47:13.353462 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:13.353874 27315 external_mini_cluster.cc:1428] Setting key b113704af5bf9be28569782183350884
I20260806 11:47:13.356513 5033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 11:47:13 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:13.365522 5033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889: Bootstrap starting.
I20260806 11:47:13.369285 5033 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:13.371213 5033 log.cc:824] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:13.372272 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:13.355841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39976 (local address 127.26.172.254:44265)
0806 11:47:13.356526 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:13.356545 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:13.356591 (+ 46us) server_negotiation.cc:407] Connection header received
0806 11:47:13.357414 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:13.357436 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:13.357847 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:13.358243 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:13.359217 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:13.360567 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:13.361493 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:13.362042 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:13.362236 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:13.365790 (+ 3554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:13.365796 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:13.365818 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:13.365879 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:13.367913 (+ 2034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:13.368447 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:13.368453 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:13.368459 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:13.368587 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:13.368901 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:13.368903 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:13.368904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:13.369390 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:13.369605 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:13.370210 (+ 605us) server_negotiation.cc:299] Negotiation successful
0806 11:47:13.370797 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":233,"threads_started":1}
I20260806 11:47:13.374409 5033 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889: No bootstrap required, opened a new log
I20260806 11:47:13.378345 5033 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd00b6d5923456aa28813483a686889" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44265 } }
I20260806 11:47:13.378659 5033 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:13.378711 5033 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbd00b6d5923456aa28813483a686889, State: Initialized, Role: FOLLOWER
I20260806 11:47:13.379271 5033 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd00b6d5923456aa28813483a686889" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44265 } }
I20260806 11:47:13.379424 5033 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:13.379473 5033 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:13.379562 5033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:13.380748 5033 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd00b6d5923456aa28813483a686889" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44265 } }
I20260806 11:47:13.381206 5033 leader_election.cc:302] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbd00b6d5923456aa28813483a686889; no voters:
I20260806 11:47:13.381666 5033 leader_election.cc:288] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:13.381820 5039 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:13.382102 5039 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [term 1 LEADER]: Becoming Leader. State: Replica: bbd00b6d5923456aa28813483a686889, State: Running, Role: LEADER
I20260806 11:47:13.382473 5039 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd00b6d5923456aa28813483a686889" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44265 } }
I20260806 11:47:13.383354 5033 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:13.384862 5041 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbd00b6d5923456aa28813483a686889. Latest consensus state: current_term: 1 leader_uuid: "bbd00b6d5923456aa28813483a686889" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd00b6d5923456aa28813483a686889" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44265 } } }
I20260806 11:47:13.385054 5041 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:13.384747 5040 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbd00b6d5923456aa28813483a686889" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbd00b6d5923456aa28813483a686889" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44265 } } }
I20260806 11:47:13.385401 5040 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:13.386246 5049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:13.391086 5049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:13.399187 5049 catalog_manager.cc:1347] Generated new cluster ID: 04d0e8435ac54066a58a519f5573fd5f
I20260806 11:47:13.399338 5049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:13.409116 5049 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:13.410452 5049 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:13.416455 5049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889: Generated new TSK 0
I20260806 11:47:13.417539 5049 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab.
Entry for principal oryx/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab.
I20260806 11:47:13.459972 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:44265
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab
--principal=oryx/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:45047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:13.615674 5068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:13.616111 5068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:13.616170 5068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:13.621173 5068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:13.621302 5068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:13.621382 5068 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 11:47:13.621461 5068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:47:13.628654 5068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:45047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab
--principal=oryx/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.172.254:44265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:13.630571 5068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:13.632112 5068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:13.646019 5078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:13.646203 5083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:13.645993 5079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:13.646620 5068 server_base.cc:1034] running on GCE node
I20260806 11:47:13.647439 5068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:13.648444 5068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:13.649711 5068 hybrid_clock.cc:648] HybridClock initialized: now 1786016833649678 us; error 52 us; skew 500 ppm
Aug 06 11:47:13 dist-test-slave-7z32 krb5kdc[4908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016833, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:13.653898 5068 init.cc:377] Logged in from keytab as oryx/127.26.172.193@KRBTEST.COM (short username oryx)
I20260806 11:47:13.655452 5068 webserver.cc:460] Webserver started at http://127.26.172.193:40101/ using document root <none> and password file <none>
I20260806 11:47:13.656245 5068 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:13.656338 5068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:13.656589 5068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:13.659619 5068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "15353e188bfa42028e31a5a1b2bcef2f"
format_stamp: "Formatted at 2026-08-06 11:47:13 on dist-test-slave-7z32"
server_key: "342dbfea276af8b4f5327081112e5471"
server_key_iv: "9dde500161c9ee086810d8b8c8e924c7"
server_key_version: "encryptionkey@0"
I20260806 11:47:13.660416 5068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "15353e188bfa42028e31a5a1b2bcef2f"
format_stamp: "Formatted at 2026-08-06 11:47:13 on dist-test-slave-7z32"
server_key: "342dbfea276af8b4f5327081112e5471"
server_key_iv: "9dde500161c9ee086810d8b8c8e924c7"
server_key_version: "encryptionkey@0"
I20260806 11:47:13.666134 5068 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:47:13.670255 5092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:13.672598 5068 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:47:13.672897 5068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "15353e188bfa42028e31a5a1b2bcef2f"
format_stamp: "Formatted at 2026-08-06 11:47:13 on dist-test-slave-7z32"
server_key: "342dbfea276af8b4f5327081112e5471"
server_key_iv: "9dde500161c9ee086810d8b8c8e924c7"
server_key_version: "encryptionkey@0"
I20260806 11:47:13.673085 5068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:13.688561 5068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:13.694373 5068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:13.694670 5068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:13.697896 5068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:13.697999 5068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:13.698087 5068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:13.698118 5068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 11:47:13 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016833, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:13.714309 5068 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:39447
I20260806 11:47:13.714732 5253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:39447 every 8 connection(s)
I20260806 11:47:13.715903 5068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:47:13.716735 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:13.699875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:53061 (local address 127.26.172.254:44265)
0806 11:47:13.702552 (+ 2677us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:13.702561 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:13.702666 (+ 105us) server_negotiation.cc:407] Connection header received
0806 11:47:13.702758 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:13.702763 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:13.702880 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:13.703017 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:13.704848 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:13.705629 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:13.707587 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:13.708047 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:13.708169 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:13.712057 (+ 3888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:13.712064 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:13.712067 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:13.712106 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:13.713904 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:13.714759 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:13.714765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:13.714768 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:13.714909 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:13.715318 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:13.715322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:13.715324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:13.715576 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:13.715705 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:13.716371 (+ 666us) server_negotiation.cc:299] Negotiation successful
0806 11:47:13.716542 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2471}
I20260806 11:47:13.717818 5106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:13.700413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:44265 (local address 127.26.172.193:53061)
0806 11:47:13.701062 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:13.701122 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:13.702373 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:13.703226 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:13.703236 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:13.703799 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:13.704582 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:13.704605 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:13.705823 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:13.705826 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:13.707438 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:13.707452 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:13.708429 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:13.708434 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:13.708697 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:13.709604 (+ 907us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:13.709632 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:13.711667 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:13.714070 (+ 2403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:13.714078 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:13.714099 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:13.714604 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:13.715041 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:13.715044 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:13.715045 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:13.715198 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:13.715705 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:13.715716 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:13.716091 (+ 375us) client_negotiation.cc:769] Sending connection context
0806 11:47:13.716327 (+ 236us) client_negotiation.cc:240] Negotiation successful
0806 11:47:13.716753 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":216,"threads_started":1}
I20260806 11:47:13.719873 5257 heartbeater.cc:347] Connected to a master server at 127.26.172.254:44265
I20260806 11:47:13.720170 5257 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:13.721123 5257 heartbeater.cc:511] Master 127.26.172.254:44265 requested a full tablet report, sending...
I20260806 11:47:13.722386 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 5068
I20260806 11:47:13.722568 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:47:13.723001 27315 external_mini_cluster.cc:1428] Setting key 1e0795c00d40d29edf185aab3b047e5b
I20260806 11:47:13.724838 4962 ts_manager.cc:194] Registered new tserver with Master: 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447)
I20260806 11:47:13.726454 4962 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:53061
I20260806 11:47:13.733242 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:13.723289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:34649 (local address 127.26.172.254:44265)
0806 11:47:13.723465 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:13.723470 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:13.723983 (+ 513us) server_negotiation.cc:407] Connection header received
0806 11:47:13.724116 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:13.724120 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:13.724185 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:13.724301 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:13.725010 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:13.725812 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:13.727351 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:13.727702 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:13.727812 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:13.729649 (+ 1837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:13.729653 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:13.729657 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:13.729688 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:13.731367 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:13.731835 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:13.731839 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:13.731841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:13.731937 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:13.732269 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:13.732273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:13.732274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:13.732541 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:13.732643 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:13.732929 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 11:47:13.733057 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 11:47:13.733253 5264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:13.723059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:44265 (local address 127.26.172.193:34649)
0806 11:47:13.723856 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:13.723873 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:13.724001 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:13.724356 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:13.724359 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:13.724645 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:13.724843 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:13.724854 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:13.726003 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:13.726018 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:13.727137 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:13.727156 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:13.728032 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:13.728036 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:13.728129 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:13.728865 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:13.728881 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:13.729462 (+ 581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:13.731493 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:13.731499 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:13.731501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:13.731721 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:13.732060 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:13.732064 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:13.732066 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:13.732161 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:13.732634 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:13.732638 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:13.732744 (+ 106us) client_negotiation.cc:769] Sending connection context
0806 11:47:13.732859 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 11:47:13.733038 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"thread_start_us":145,"threads_started":1}
WARNING: no policy specified for oryx/127.26.172.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab.
Entry for principal oryx/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab.
I20260806 11:47:13.763381 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:44265
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab
--principal=oryx/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:45047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:13.899531 5267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:13.899863 5267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:13.899911 5267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:13.904109 5267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:13.904196 5267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:13.904238 5267 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 11:47:13.904274 5267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:47:13.910080 5267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:45047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab
--principal=oryx/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.172.254:44265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:13.911504 5267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:13.912992 5267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:13.927034 5276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:13.927205 5272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:13.927253 5274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:13.927786 5267 server_base.cc:1034] running on GCE node
I20260806 11:47:13.928395 5267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:13.929404 5267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:13.932907 5267 hybrid_clock.cc:648] HybridClock initialized: now 1786016833932832 us; error 86 us; skew 500 ppm
Aug 06 11:47:13 dist-test-slave-7z32 krb5kdc[4908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016833, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:13.942355 5267 init.cc:377] Logged in from keytab as oryx/127.26.172.194@KRBTEST.COM (short username oryx)
I20260806 11:47:13.944018 5267 webserver.cc:460] Webserver started at http://127.26.172.194:37639/ using document root <none> and password file <none>
I20260806 11:47:13.944880 5267 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:13.944972 5267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:13.945271 5267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:13.948210 5267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "a1435d096e334cff8a09afe7c6b5cf2a"
format_stamp: "Formatted at 2026-08-06 11:47:13 on dist-test-slave-7z32"
server_key: "b7f0988d750dd1c87ae0d1a5cbb7fc1e"
server_key_iv: "9bd56ba1887d8543b50e56f9130cada3"
server_key_version: "encryptionkey@0"
I20260806 11:47:13.948982 5267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "a1435d096e334cff8a09afe7c6b5cf2a"
format_stamp: "Formatted at 2026-08-06 11:47:13 on dist-test-slave-7z32"
server_key: "b7f0988d750dd1c87ae0d1a5cbb7fc1e"
server_key_iv: "9bd56ba1887d8543b50e56f9130cada3"
server_key_version: "encryptionkey@0"
I20260806 11:47:13.955020 5267 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260806 11:47:13.958966 5283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:13.961139 5267 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:47:13.961421 5267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "a1435d096e334cff8a09afe7c6b5cf2a"
format_stamp: "Formatted at 2026-08-06 11:47:13 on dist-test-slave-7z32"
server_key: "b7f0988d750dd1c87ae0d1a5cbb7fc1e"
server_key_iv: "9bd56ba1887d8543b50e56f9130cada3"
server_key_version: "encryptionkey@0"
I20260806 11:47:13.961612 5267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:13.987502 5267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:13.991321 5267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:13.991585 5267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:13.993486 5267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:13.993572 5267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:13.993647 5267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:13.993693 5267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 11:47:14 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016833, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:14.008314 5267 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:34391
I20260806 11:47:14.008424 5437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:34391 every 8 connection(s)
I20260806 11:47:14.009680 5267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:47:14.014261 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:13.995171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:36461 (local address 127.26.172.254:44265)
0806 11:47:13.995404 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:13.995410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:13.996559 (+ 1149us) server_negotiation.cc:407] Connection header received
0806 11:47:13.998271 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:13.998277 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:13.998368 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:13.998528 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:14.000829 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.001838 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.003901 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.004234 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.004475 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.008903 (+ 4428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:14.008908 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:14.008912 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:14.008956 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:14.011324 (+ 2368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.012249 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.012253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.012255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.012375 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.012780 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.012783 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.012784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.013049 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:14.013150 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.013851 (+ 701us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.014031 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 11:47:14.015098 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:13.995683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:44265 (local address 127.26.172.194:36461)
0806 11:47:13.996330 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:13.996395 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:13.997859 (+ 1464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:13.998866 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:13.998882 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:13.999551 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:14.000610 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.000631 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.002100 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.002107 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.003676 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.003696 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.004571 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.004577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.004838 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.006014 (+ 1176us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:14.006050 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:14.008537 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:14.011543 (+ 3006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:14.011551 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:14.011568 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:14.012072 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:14.012497 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:14.012500 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:14.012501 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:14.012659 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:14.013178 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:14.013184 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:14.013538 (+ 354us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.013715 (+ 177us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.014037 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":202,"threads_started":1}
I20260806 11:47:14.015441 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 5267
I20260806 11:47:14.015605 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:47:14.016062 27315 external_mini_cluster.cc:1428] Setting key 9ddab2a75f27fbe250cafb8fe19dd634
I20260806 11:47:14.017030 5438 heartbeater.cc:347] Connected to a master server at 127.26.172.254:44265
I20260806 11:47:14.017270 5438 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:14.018163 5438 heartbeater.cc:511] Master 127.26.172.254:44265 requested a full tablet report, sending...
I20260806 11:47:14.019629 4967 ts_manager.cc:194] Registered new tserver with Master: a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391)
I20260806 11:47:14.020670 4967 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:36461
I20260806 11:47:14.028666 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.020316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:38293 (local address 127.26.172.254:44265)
0806 11:47:14.020530 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.020537 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.020567 (+ 30us) server_negotiation.cc:407] Connection header received
0806 11:47:14.020774 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.020778 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.020842 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.020935 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:14.021536 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.022093 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.023072 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.023317 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.023444 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.024777 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:14.024781 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:14.024784 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:14.024810 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:14.026741 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.027252 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.027256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.027258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.027355 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.027676 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.027680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.027681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.027942 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:14.028061 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.028356 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.028483 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 11:47:14.028677 5446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.019810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:44265 (local address 127.26.172.194:38293)
0806 11:47:14.020470 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.020491 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.020625 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.020978 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.020982 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.021257 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:14.021407 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.021416 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.022233 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.022236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.022945 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.022954 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.023462 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.023466 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.023564 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.024242 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:14.024254 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:14.024624 (+ 370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:14.026896 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:14.026901 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:14.026903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:14.027138 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:14.027458 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:14.027461 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:14.027463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:14.027564 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:14.028050 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:14.028053 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:14.028170 (+ 117us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.028287 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.028466 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":159,"threads_started":1}
WARNING: no policy specified for oryx/127.26.172.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab.
Entry for principal oryx/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab.
I20260806 11:47:14.060388 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:44265
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab
--principal=oryx/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:45047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:14.222014 5451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:14.222481 5451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:14.222572 5451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:14.227367 5451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:14.227495 5451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:14.227577 5451 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 11:47:14.227670 5451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:47:14.235025 5451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:45047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab
--principal=oryx/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.172.254:44265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:14.236730 5451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:14.238523 5451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:14.252848 5456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:14.252878 5458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:14.252878 5460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:14.253669 5451 server_base.cc:1034] running on GCE node
I20260806 11:47:14.254405 5451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:14.255638 5451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:14.256891 5451 hybrid_clock.cc:648] HybridClock initialized: now 1786016834256849 us; error 95 us; skew 500 ppm
Aug 06 11:47:14 dist-test-slave-7z32 krb5kdc[4908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016834, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:14.262173 5451 init.cc:377] Logged in from keytab as oryx/127.26.172.195@KRBTEST.COM (short username oryx)
I20260806 11:47:14.263833 5451 webserver.cc:460] Webserver started at http://127.26.172.195:42329/ using document root <none> and password file <none>
I20260806 11:47:14.264954 5451 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:14.265084 5451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:14.265395 5451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:14.268932 5451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "62471ee08c29476191b956552b3f6b39"
format_stamp: "Formatted at 2026-08-06 11:47:14 on dist-test-slave-7z32"
server_key: "87ac728432ad888ddd984b5efc7a76ba"
server_key_iv: "7443bc68b664976f1b705fed609580f5"
server_key_version: "encryptionkey@0"
I20260806 11:47:14.269860 5451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "62471ee08c29476191b956552b3f6b39"
format_stamp: "Formatted at 2026-08-06 11:47:14 on dist-test-slave-7z32"
server_key: "87ac728432ad888ddd984b5efc7a76ba"
server_key_iv: "7443bc68b664976f1b705fed609580f5"
server_key_version: "encryptionkey@0"
I20260806 11:47:14.277223 5451 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.005s
I20260806 11:47:14.282100 5479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:14.284550 5451 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260806 11:47:14.284799 5451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "62471ee08c29476191b956552b3f6b39"
format_stamp: "Formatted at 2026-08-06 11:47:14 on dist-test-slave-7z32"
server_key: "87ac728432ad888ddd984b5efc7a76ba"
server_key_iv: "7443bc68b664976f1b705fed609580f5"
server_key_version: "encryptionkey@0"
I20260806 11:47:14.285071 5451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:14.302076 5451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:14.306422 5451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:14.306706 5451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:14.308722 5451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:14.308820 5451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:14.308890 5451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:14.308943 5451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 11:47:14 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016834, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:14.323773 5451 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:32927
I20260806 11:47:14.323972 5633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:32927 every 8 connection(s)
I20260806 11:47:14.325197 5451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:47:14.326257 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 5451
I20260806 11:47:14.326411 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:47:14.326817 27315 external_mini_cluster.cc:1428] Setting key ad8658ae1887a2a7f7b26174d6505c90
I20260806 11:47:14.329779 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.310186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:39803 (local address 127.26.172.254:44265)
0806 11:47:14.310351 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.310356 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.312070 (+ 1714us) server_negotiation.cc:407] Connection header received
0806 11:47:14.313909 (+ 1839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.313915 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.313992 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.314047 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:14.316568 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.317661 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.319943 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.320393 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.320570 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.324653 (+ 4083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:14.324661 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:14.324668 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:14.324711 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:14.326792 (+ 2081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.327618 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.327622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.327623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.327715 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.328282 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.328288 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.328294 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.328534 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:14.328666 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.329414 (+ 748us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.329585 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 11:47:14.331086 5493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.311012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:44265 (local address 127.26.172.195:39803)
0806 11:47:14.311744 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.311900 (+ 156us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.313535 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.314607 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.314620 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.315385 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:14.316275 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.316303 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.317990 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.317996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.319771 (+ 1775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.319786 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.320626 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.320629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.320948 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.321862 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:14.321896 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:14.324364 (+ 2468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:14.326962 (+ 2598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:14.326971 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:14.326991 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:14.327466 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:14.327843 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:14.327848 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:14.327851 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:14.328106 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:14.328668 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:14.328679 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:14.329122 (+ 443us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.329357 (+ 235us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.329828 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":181,"threads_started":1}
I20260806 11:47:14.332969 5634 heartbeater.cc:347] Connected to a master server at 127.26.172.254:44265
I20260806 11:47:14.333230 5634 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:14.334012 5634 heartbeater.cc:511] Master 127.26.172.254:44265 requested a full tablet report, sending...
I20260806 11:47:14.335570 4967 ts_manager.cc:194] Registered new tserver with Master: 62471ee08c29476191b956552b3f6b39 (127.26.172.195:32927)
I20260806 11:47:14.336521 4967 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:39803
I20260806 11:47:14.342003 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:47:14.346690 5642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.336027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:44265 (local address 127.26.172.195:38789)
0806 11:47:14.336572 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.336587 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.336735 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.337113 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.337117 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.337415 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:14.337574 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.337644 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.338930 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.338933 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.339627 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.339638 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.340317 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.340322 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.340461 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.341177 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:14.341191 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:14.341635 (+ 444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:14.343932 (+ 2297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:14.343936 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:14.343943 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:14.344279 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:14.344707 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:14.344712 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:14.344716 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:14.345165 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:14.345855 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:14.345859 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:14.346034 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.346198 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.346405 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":3,"thread_start_us":157,"threads_started":1}
I20260806 11:47:14.347043 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.336189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:38789 (local address 127.26.172.254:44265)
0806 11:47:14.336357 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.336363 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.336679 (+ 316us) server_negotiation.cc:407] Connection header received
0806 11:47:14.336875 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.336878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.336955 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.337052 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:14.337820 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.338680 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.339830 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.340131 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.340297 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.341820 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:14.341825 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:14.341828 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:14.341872 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:14.343760 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.344445 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.344451 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.344453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.344570 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.345292 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.345297 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.345299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.345635 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:14.345781 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.346330 (+ 549us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.346522 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
Aug 06 11:47:14 dist-test-slave-7z32 krb5kdc[4908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016834, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 11:47:14 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:14 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
W20260806 11:47:14.376255 5037 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:14.368570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39992 (local address 127.26.172.254:44265)
0806 11:47:14.368769 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.368777 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.368911 (+ 134us) server_negotiation.cc:407] Connection header received
0806 11:47:14.369148 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.369152 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.369213 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.369311 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:14.370177 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.370774 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.371844 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.372097 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.372223 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.376114 (+ 3891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39992: BlockingRecv error: recv got EOF from 127.0.0.1:39992 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 06 11:47:14 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016834, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:14.390540 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.379561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39994 (local address 127.26.172.254:44265)
0806 11:47:14.379752 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.379757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.379824 (+ 67us) server_negotiation.cc:407] Connection header received
0806 11:47:14.379983 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.379986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.380041 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.380155 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:14.380919 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.381484 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.382375 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.382656 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.382751 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.385988 (+ 3237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:14.385992 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:14.385995 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:14.386032 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:14.388017 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.388723 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.388727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.388728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.388852 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.389320 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.389324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.389326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.389598 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:14.389722 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.390108 (+ 386us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.390315 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260806 11:47:14.395197 4967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:47:14.399758 4967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:47:14.424520 5672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.416725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55860 (local address 127.26.172.193:39447)
0806 11:47:14.417110 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.417117 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.418546 (+ 1429us) server_negotiation.cc:407] Connection header received
0806 11:47:14.418705 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.418710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.418966 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.419142 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:14.419379 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.420619 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.422067 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.423186 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.423361 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.423555 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.424161 (+ 606us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.424313 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":141,"threads_started":1}
I20260806 11:47:14.424520 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.416118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:39447 (local address 127.0.0.1:55860)
0806 11:47:14.418411 (+ 2293us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.418425 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.418557 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.419111 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.419115 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.419135 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:14.419265 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.419275 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.420758 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.420765 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.421911 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.421923 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.423642 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.423646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.423908 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.423963 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.424118 (+ 155us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.424313 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2225,"mutex_wait_us":78,"thread_start_us":148,"threads_started":1}
I20260806 11:47:14.425261 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.416235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38712 (local address 127.26.172.195:32927)
0806 11:47:14.417444 (+ 1209us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.417457 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.417481 (+ 24us) server_negotiation.cc:407] Connection header received
0806 11:47:14.417609 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.417616 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.417869 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.418067 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:14.418473 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.419938 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.422059 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.423105 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.423318 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.423544 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.424911 (+ 1367us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.425033 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1086,"thread_start_us":175,"threads_started":1}
I20260806 11:47:14.425361 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.414611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:34391 (local address 127.0.0.1:44596)
0806 11:47:14.415365 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.415445 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.415635 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.417605 (+ 1970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.417614 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.417645 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:14.417866 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.417874 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.419643 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.419647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.422087 (+ 2440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.422101 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.423775 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.423779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.425004 (+ 1225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.425033 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.425127 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.425223 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"mutex_wait_us":1480,"thread_start_us":109,"threads_started":1}
I20260806 11:47:14.425554 5667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.414751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44596 (local address 127.26.172.194:34391)
0806 11:47:14.417053 (+ 2302us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.417067 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.417094 (+ 27us) server_negotiation.cc:407] Connection header received
0806 11:47:14.417189 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.417195 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.417399 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.417546 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:14.418129 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.419465 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.422278 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.423247 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.423405 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.424018 (+ 613us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.425224 (+ 1206us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.425376 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2116,"thread_start_us":1821,"threads_started":1}
I20260806 11:47:14.425789 5670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.414964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:32927 (local address 127.0.0.1:38712)
0806 11:47:14.416935 (+ 1971us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.416955 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.417077 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.418069 (+ 992us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.418074 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.418102 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:14.418275 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.418283 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.420082 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.420085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.421693 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.421710 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.423650 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.423657 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.424309 (+ 652us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.424342 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.425477 (+ 1135us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.425609 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1869,"mutex_wait_us":546,"thread_start_us":158,"threads_started":1}
I20260806 11:47:14.428445 5168 tablet_service.cc:1467] Processing CreateTablet for tablet aa008e48cd914df592809bc89046f4c6 (DEFAULT_TABLE table=test-table [id=cf05d7cc52674a2e843e82f8f8b1776f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:14.429183 5351 tablet_service.cc:1467] Processing CreateTablet for tablet aa008e48cd914df592809bc89046f4c6 (DEFAULT_TABLE table=test-table [id=cf05d7cc52674a2e843e82f8f8b1776f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:14.429181 5545 tablet_service.cc:1467] Processing CreateTablet for tablet aa008e48cd914df592809bc89046f4c6 (DEFAULT_TABLE table=test-table [id=cf05d7cc52674a2e843e82f8f8b1776f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:14.430225 5168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa008e48cd914df592809bc89046f4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:14.430598 5545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa008e48cd914df592809bc89046f4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:14.430595 5351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa008e48cd914df592809bc89046f4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:14.438288 5674 tablet_bootstrap.cc:492] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: Bootstrap starting.
I20260806 11:47:14.440970 5674 tablet_bootstrap.cc:654] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:14.441342 5675 tablet_bootstrap.cc:492] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: Bootstrap starting.
I20260806 11:47:14.442901 5674 log.cc:824] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:14.443341 5676 tablet_bootstrap.cc:492] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: Bootstrap starting.
I20260806 11:47:14.443846 5675 tablet_bootstrap.cc:654] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:14.444794 5675 log.cc:824] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:14.445683 5674 tablet_bootstrap.cc:492] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: No bootstrap required, opened a new log
I20260806 11:47:14.445940 5674 ts_tablet_manager.cc:1397] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 11:47:14.446767 5676 tablet_bootstrap.cc:654] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:14.448019 5675 tablet_bootstrap.cc:492] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: No bootstrap required, opened a new log
I20260806 11:47:14.448169 5676 log.cc:824] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:14.448292 5675 ts_tablet_manager.cc:1397] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 11:47:14.450425 5676 tablet_bootstrap.cc:492] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: No bootstrap required, opened a new log
I20260806 11:47:14.450699 5676 ts_tablet_manager.cc:1397] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260806 11:47:14.450953 5674 raft_consensus.cc:348] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } }
I20260806 11:47:14.451325 5674 raft_consensus.cc:374] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:14.451395 5674 raft_consensus.cc:729] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15353e188bfa42028e31a5a1b2bcef2f, State: Initialized, Role: FOLLOWER
I20260806 11:47:14.451949 5674 consensus_queue.cc:260] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } }
I20260806 11:47:14.452808 5675 raft_consensus.cc:348] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } }
I20260806 11:47:14.453104 5675 raft_consensus.cc:374] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:14.453172 5675 raft_consensus.cc:729] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62471ee08c29476191b956552b3f6b39, State: Initialized, Role: FOLLOWER
I20260806 11:47:14.453189 5674 ts_tablet_manager.cc:1428] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 11:47:14.453624 5257 heartbeater.cc:503] Master 127.26.172.254:44265 was elected leader, sending a full tablet report...
I20260806 11:47:14.453684 5675 consensus_queue.cc:260] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } }
I20260806 11:47:14.454588 5634 heartbeater.cc:503] Master 127.26.172.254:44265 was elected leader, sending a full tablet report...
I20260806 11:47:14.455480 5675 ts_tablet_manager.cc:1428] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 11:47:14.455564 5676 raft_consensus.cc:348] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } }
I20260806 11:47:14.455952 5676 raft_consensus.cc:374] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:14.456015 5676 raft_consensus.cc:729] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1435d096e334cff8a09afe7c6b5cf2a, State: Initialized, Role: FOLLOWER
I20260806 11:47:14.456547 5676 consensus_queue.cc:260] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } }
I20260806 11:47:14.457504 5438 heartbeater.cc:503] Master 127.26.172.254:44265 was elected leader, sending a full tablet report...
I20260806 11:47:14.458339 5676 ts_tablet_manager.cc:1428] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
W20260806 11:47:14.470414 5258 tablet.cc:2369] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:47:14.511653 5439 tablet.cc:2369] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:47:14.570796 5684 raft_consensus.cc:482] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:47:14.571156 5684 raft_consensus.cc:504] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } }
I20260806 11:47:14.572551 5684 leader_election.cc:288] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391), 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447)
W20260806 11:47:14.576795 5635 tablet.cc:2369] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:47:14.577800 5672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.573857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:50443 (local address 127.26.172.193:39447)
0806 11:47:14.574021 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.574027 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.574176 (+ 149us) server_negotiation.cc:407] Connection header received
0806 11:47:14.574342 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.574345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.574397 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.574498 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:14.574853 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.575380 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.576560 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.577157 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.577294 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.577363 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.577558 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.577642 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 11:47:14.577821 5686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.573594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:39447 (local address 127.26.172.195:50443)
0806 11:47:14.574075 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.574094 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.574216 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.574513 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.574517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.574534 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:14.574697 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.574704 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.575519 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.575525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.576400 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.576410 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.577294 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.577298 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.577426 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.577457 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.577541 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.577664 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":4,"thread_start_us":182,"threads_started":1}
I20260806 11:47:14.578864 5667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.573312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:55377 (local address 127.26.172.194:34391)
0806 11:47:14.573535 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.573541 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.573561 (+ 20us) server_negotiation.cc:407] Connection header received
0806 11:47:14.573828 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.573833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.573915 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.574065 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:14.574422 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.575130 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.577186 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.577822 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.578007 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.578135 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.578580 (+ 445us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.578683 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260806 11:47:14.578884 5493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.573093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:34391 (local address 127.26.172.195:55377)
0806 11:47:14.573409 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.573432 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.573580 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.574083 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.574087 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.574123 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:14.574284 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.574292 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.575262 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.575269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.576989 (+ 1720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.577003 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.578234 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.578238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.578419 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.578444 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.578555 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.578667 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260806 11:47:14.579061 5170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa008e48cd914df592809bc89046f4c6" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15353e188bfa42028e31a5a1b2bcef2f" is_pre_election: true
I20260806 11:47:14.579460 5170 raft_consensus.cc:2454] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 0.
I20260806 11:47:14.579644 5380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa008e48cd914df592809bc89046f4c6" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" is_pre_election: true
I20260806 11:47:14.579916 5380 raft_consensus.cc:2454] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 0.
I20260806 11:47:14.580197 5480 leader_election.cc:302] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15353e188bfa42028e31a5a1b2bcef2f, 62471ee08c29476191b956552b3f6b39; no voters:
I20260806 11:47:14.580641 5684 raft_consensus.cc:2781] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:47:14.580742 5684 raft_consensus.cc:482] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:47:14.580775 5684 raft_consensus.cc:3037] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:14.582063 5684 raft_consensus.cc:504] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } }
I20260806 11:47:14.582502 5684 leader_election.cc:288] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 election: Requested vote from peers a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391), 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447)
I20260806 11:47:14.583226 5380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa008e48cd914df592809bc89046f4c6" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1435d096e334cff8a09afe7c6b5cf2a"
I20260806 11:47:14.583377 5380 raft_consensus.cc:3037] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:14.583570 5170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa008e48cd914df592809bc89046f4c6" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15353e188bfa42028e31a5a1b2bcef2f"
I20260806 11:47:14.583847 5170 raft_consensus.cc:3037] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:14.585155 5380 raft_consensus.cc:2454] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 1.
I20260806 11:47:14.585582 5170 raft_consensus.cc:2454] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 1.
I20260806 11:47:14.585913 5480 leader_election.cc:302] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62471ee08c29476191b956552b3f6b39, a1435d096e334cff8a09afe7c6b5cf2a; no voters:
I20260806 11:47:14.586158 5684 raft_consensus.cc:2781] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:14.586438 5684 raft_consensus.cc:686] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 1 LEADER]: Becoming Leader. State: Replica: 62471ee08c29476191b956552b3f6b39, State: Running, Role: LEADER
I20260806 11:47:14.586911 5684 consensus_queue.cc:237] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } }
I20260806 11:47:14.591406 4967 catalog_manager.cc:5495] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62471ee08c29476191b956552b3f6b39 (127.26.172.195). New cstate: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } health_report { overall_health: UNKNOWN } } }
I20260806 11:47:14.618111 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.613193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38728 (local address 127.26.172.195:32927)
0806 11:47:14.613381 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.613386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.613404 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:47:14.613572 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.613575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.613638 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.613764 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:47:14.614136 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.614800 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.616003 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.616271 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.616451 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.616895 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:47:14.617499 (+ 604us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:47:14.617655 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.617894 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.617974 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 11:47:14.626816 5170 raft_consensus.cc:1261] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Refusing update from remote peer 62471ee08c29476191b956552b3f6b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:14.626816 5380 raft_consensus.cc:1261] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Refusing update from remote peer 62471ee08c29476191b956552b3f6b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:14.628185 5684 consensus_queue.cc:1035] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:14.628551 5687 consensus_queue.cc:1035] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:14.642177 5693 mvcc.cc:205] Tried to move back new op lower bound from 7315524954619183104 to 7315524954472525824. Current Snapshot: MvccSnapshot[applied={T|T < 7315524954619183104}]
I20260806 11:47:14.642441 5692 mvcc.cc:205] Tried to move back new op lower bound from 7315524954619183104 to 7315524954472525824. Current Snapshot: MvccSnapshot[applied={T|T < 7315524954619183104}]
I20260806 11:47:14.657737 4962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:14.658070 4962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:14.662026 4962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889: Sending DeleteTablet for 3 replicas of tablet aa008e48cd914df592809bc89046f4c6
I20260806 11:47:14.663332 5168 tablet_service.cc:1514] Processing DeleteTablet for tablet aa008e48cd914df592809bc89046f4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:14 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:55860
I20260806 11:47:14.663331 5351 tablet_service.cc:1514] Processing DeleteTablet for tablet aa008e48cd914df592809bc89046f4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:14 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:44596
I20260806 11:47:14.663502 5545 tablet_service.cc:1514] Processing DeleteTablet for tablet aa008e48cd914df592809bc89046f4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:14 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:38712
I20260806 11:47:14.664026 5704 tablet_replica.cc:330] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: stopping tablet replica
I20260806 11:47:14.664331 5703 tablet_replica.cc:330] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: stopping tablet replica
I20260806 11:47:14.664467 5704 raft_consensus.cc:2229] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:14.664805 5703 raft_consensus.cc:2229] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:14.664901 5704 raft_consensus.cc:2258] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:14.665246 5703 raft_consensus.cc:2258] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:14.665300 4962 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:47:14.665870 4962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:47:14.666086 5705 tablet_replica.cc:330] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: stopping tablet replica
I20260806 11:47:14.666545 5705 raft_consensus.cc:2229] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:47:14.667258 5705 raft_consensus.cc:2258] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:14.669159 5704 ts_tablet_manager.cc:1905] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:14.670065 5705 ts_tablet_manager.cc:1905] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:14.671337 5703 ts_tablet_manager.cc:1905] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:14.673483 5168 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe8b8fa96d84cbb82c54530057a586d (DEFAULT_TABLE table=test-table [id=175e642454044b2ab5aa00d866e46e42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:14.673460 5351 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe8b8fa96d84cbb82c54530057a586d (DEFAULT_TABLE table=test-table [id=175e642454044b2ab5aa00d866e46e42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:14.673679 5545 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe8b8fa96d84cbb82c54530057a586d (DEFAULT_TABLE table=test-table [id=175e642454044b2ab5aa00d866e46e42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:14.673801 5168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe8b8fa96d84cbb82c54530057a586d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:14.673803 5351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe8b8fa96d84cbb82c54530057a586d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:14.674062 5545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe8b8fa96d84cbb82c54530057a586d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:14.676499 5674 tablet_bootstrap.cc:492] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f: Bootstrap starting.
I20260806 11:47:14.677860 5674 tablet_bootstrap.cc:654] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:14.677872 5675 tablet_bootstrap.cc:492] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39: Bootstrap starting.
I20260806 11:47:14.679584 5676 tablet_bootstrap.cc:492] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a: Bootstrap starting.
I20260806 11:47:14.679602 5675 tablet_bootstrap.cc:654] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:14.679850 5704 ts_tablet_manager.cc:1918] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:14.680024 5704 log.cc:1196] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/aa008e48cd914df592809bc89046f4c6
I20260806 11:47:14.680428 5704 ts_tablet_manager.cc:1939] T aa008e48cd914df592809bc89046f4c6 P 15353e188bfa42028e31a5a1b2bcef2f: Deleting consensus metadata
I20260806 11:47:14.680954 5676 tablet_bootstrap.cc:654] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:14.682289 4945 catalog_manager.cc:4841] TS 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447): tablet aa008e48cd914df592809bc89046f4c6 (table test-table [id=cf05d7cc52674a2e843e82f8f8b1776f]) successfully deleted
I20260806 11:47:14.683357 5705 ts_tablet_manager.cc:1918] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:14.683610 5676 tablet_bootstrap.cc:492] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a: No bootstrap required, opened a new log
I20260806 11:47:14.683705 5676 ts_tablet_manager.cc:1397] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:14.683977 5674 tablet_bootstrap.cc:492] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f: No bootstrap required, opened a new log
I20260806 11:47:14.684063 5674 ts_tablet_manager.cc:1397] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260806 11:47:14.684360 5676 raft_consensus.cc:348] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.684489 5676 raft_consensus.cc:374] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:14.684530 5676 raft_consensus.cc:729] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1435d096e334cff8a09afe7c6b5cf2a, State: Initialized, Role: FOLLOWER
I20260806 11:47:14.684831 5676 consensus_queue.cc:260] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.684811 5674 raft_consensus.cc:348] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.684945 5674 raft_consensus.cc:374] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:14.684981 5674 raft_consensus.cc:729] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15353e188bfa42028e31a5a1b2bcef2f, State: Initialized, Role: FOLLOWER
I20260806 11:47:14.685139 5676 ts_tablet_manager.cc:1428] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 11:47:14.685101 5674 consensus_queue.cc:260] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.685907 5705 log.cc:1196] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/aa008e48cd914df592809bc89046f4c6
I20260806 11:47:14.686381 5705 ts_tablet_manager.cc:1939] T aa008e48cd914df592809bc89046f4c6 P 62471ee08c29476191b956552b3f6b39: Deleting consensus metadata
I20260806 11:47:14.688021 4946 catalog_manager.cc:4841] TS 62471ee08c29476191b956552b3f6b39 (127.26.172.195:32927): tablet aa008e48cd914df592809bc89046f4c6 (table test-table [id=cf05d7cc52674a2e843e82f8f8b1776f]) successfully deleted
I20260806 11:47:14.688341 5674 ts_tablet_manager.cc:1428] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260806 11:47:14.688776 5703 ts_tablet_manager.cc:1918] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:14.688933 5703 log.cc:1196] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/aa008e48cd914df592809bc89046f4c6
I20260806 11:47:14.689343 5703 ts_tablet_manager.cc:1939] T aa008e48cd914df592809bc89046f4c6 P a1435d096e334cff8a09afe7c6b5cf2a: Deleting consensus metadata
I20260806 11:47:14.690080 5675 tablet_bootstrap.cc:492] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39: No bootstrap required, opened a new log
I20260806 11:47:14.690188 5675 ts_tablet_manager.cc:1397] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260806 11:47:14.690758 5675 raft_consensus.cc:348] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.690953 5675 raft_consensus.cc:374] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:14.690996 5675 raft_consensus.cc:729] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62471ee08c29476191b956552b3f6b39, State: Initialized, Role: FOLLOWER
I20260806 11:47:14.691027 4945 catalog_manager.cc:4841] TS a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391): tablet aa008e48cd914df592809bc89046f4c6 (table test-table [id=cf05d7cc52674a2e843e82f8f8b1776f]) successfully deleted
I20260806 11:47:14.691119 5675 consensus_queue.cc:260] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.691414 5675 ts_tablet_manager.cc:1428] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 11:47:14.746402 5685 raft_consensus.cc:482] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:47:14.746630 5685 raft_consensus.cc:504] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.748163 5685 leader_election.cc:288] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447), 62471ee08c29476191b956552b3f6b39 (127.26.172.195:32927)
I20260806 11:47:14.753506 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.748830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:35429 (local address 127.26.172.195:32927)
0806 11:47:14.748971 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.748977 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.749315 (+ 338us) server_negotiation.cc:407] Connection header received
0806 11:47:14.749397 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.749404 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.749479 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.749561 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:14.749957 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.750562 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.752132 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.752817 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.752971 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.753048 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.753282 (+ 234us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.753387 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 11:47:14.753525 5710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.748466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:32927 (local address 127.26.172.194:35429)
0806 11:47:14.749079 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.749100 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.749260 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.749624 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.749627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.749649 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:14.749817 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.749824 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.750686 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.750689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.751961 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.751972 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.753000 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.753004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.753118 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.753153 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.753253 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.753345 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":106,"threads_started":1}
I20260806 11:47:14.753799 5672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.748713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:43317 (local address 127.26.172.193:39447)
0806 11:47:14.748859 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.748865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.749516 (+ 651us) server_negotiation.cc:407] Connection header received
0806 11:47:14.749690 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.749694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.749745 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.749785 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:14.750251 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.751128 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.752445 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.752869 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.753016 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.753081 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.753480 (+ 399us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.753620 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 11:47:14.754289 5709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.748496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:39447 (local address 127.26.172.194:43317)
0806 11:47:14.749348 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.749368 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.749517 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.749930 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.749934 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.749955 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:14.750090 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.750097 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.751270 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.751274 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.752290 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.752299 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.753160 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.753165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.753298 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.753329 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.754022 (+ 693us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.754126 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":178,"threads_started":1}
I20260806 11:47:14.754308 5571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe8b8fa96d84cbb82c54530057a586d" candidate_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62471ee08c29476191b956552b3f6b39" is_pre_election: true
I20260806 11:47:14.754596 5571 raft_consensus.cc:2454] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1435d096e334cff8a09afe7c6b5cf2a in term 0.
I20260806 11:47:14.754760 5170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe8b8fa96d84cbb82c54530057a586d" candidate_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15353e188bfa42028e31a5a1b2bcef2f" is_pre_election: true
I20260806 11:47:14.754953 5170 raft_consensus.cc:2454] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1435d096e334cff8a09afe7c6b5cf2a in term 0.
I20260806 11:47:14.755438 5288 leader_election.cc:302] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 15353e188bfa42028e31a5a1b2bcef2f, 62471ee08c29476191b956552b3f6b39, a1435d096e334cff8a09afe7c6b5cf2a; no voters:
I20260806 11:47:14.755784 5685 raft_consensus.cc:2781] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:47:14.755873 5685 raft_consensus.cc:482] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:47:14.755913 5685 raft_consensus.cc:3037] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:14.757807 5685 raft_consensus.cc:504] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.758409 5685 leader_election.cc:288] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [CANDIDATE]: Term 1 election: Requested vote from peers 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447), 62471ee08c29476191b956552b3f6b39 (127.26.172.195:32927)
I20260806 11:47:14.759088 5571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe8b8fa96d84cbb82c54530057a586d" candidate_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62471ee08c29476191b956552b3f6b39"
I20260806 11:47:14.759191 5170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe8b8fa96d84cbb82c54530057a586d" candidate_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15353e188bfa42028e31a5a1b2bcef2f"
I20260806 11:47:14.759277 5571 raft_consensus.cc:3037] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:14.759387 5170 raft_consensus.cc:3037] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:14.760618 5571 raft_consensus.cc:2454] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1435d096e334cff8a09afe7c6b5cf2a in term 1.
I20260806 11:47:14.761015 5170 raft_consensus.cc:2454] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1435d096e334cff8a09afe7c6b5cf2a in term 1.
I20260806 11:47:14.761847 5288 leader_election.cc:302] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 15353e188bfa42028e31a5a1b2bcef2f, 62471ee08c29476191b956552b3f6b39, a1435d096e334cff8a09afe7c6b5cf2a; no voters:
I20260806 11:47:14.762424 5685 raft_consensus.cc:2781] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:14.762768 5685 raft_consensus.cc:686] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 1 LEADER]: Becoming Leader. State: Replica: a1435d096e334cff8a09afe7c6b5cf2a, State: Running, Role: LEADER
I20260806 11:47:14.763219 5685 consensus_queue.cc:237] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.766664 4964 catalog_manager.cc:5495] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194). New cstate: current_term: 1 leader_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } health_report { overall_health: UNKNOWN } } }
Aug 06 11:47:14 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016833, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.254@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:14.824110 5724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.809327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:44265 (local address 127.0.0.1:40000)
0806 11:47:14.809865 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.809891 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.810123 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.810559 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.810563 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.811466 (+ 903us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:14.811660 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.811671 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.812744 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.812748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.813836 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.813852 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.814538 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.814542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.814660 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.815650 (+ 990us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:14.815671 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:14.818113 (+ 2442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:14.821356 (+ 3243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:14.821381 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:14.821394 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:14.821833 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:14.822352 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:14.822356 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:14.822357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:14.822496 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:14.823354 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:14.823363 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:14.823594 (+ 231us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.823736 (+ 142us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.823921 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":173,"threads_started":1}
I20260806 11:47:14.824611 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.809592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40000 (local address 127.26.172.254:44265)
0806 11:47:14.809785 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.809790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.810070 (+ 280us) server_negotiation.cc:407] Connection header received
0806 11:47:14.810279 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.810282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.810340 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.810446 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:14.811935 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.812551 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.814061 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.814335 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.814464 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.818446 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:14.818452 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:14.818456 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:14.818497 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:14.821063 (+ 2566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.822018 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.822024 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.822026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.822172 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:14.822657 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:14.822661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:14.822663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:14.823056 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:14.823324 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.823852 (+ 528us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.824059 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 11:47:14.829782 4964 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:40000:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 11:47:14.830765 4964 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:47:14.837531 5351 tablet_service.cc:1467] Processing CreateTablet for tablet 25417386718d46c38c2d62b41f88a904 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a70fa3093f1549659e754a5dd552a32c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 11:47:14.837736 5168 tablet_service.cc:1467] Processing CreateTablet for tablet 25417386718d46c38c2d62b41f88a904 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a70fa3093f1549659e754a5dd552a32c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 11:47:14.838125 5351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25417386718d46c38c2d62b41f88a904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:14.838384 5168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25417386718d46c38c2d62b41f88a904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:14.841238 5676 tablet_bootstrap.cc:492] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: Bootstrap starting.
I20260806 11:47:14.842437 5676 tablet_bootstrap.cc:654] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:14.842983 5545 tablet_service.cc:1467] Processing CreateTablet for tablet 25417386718d46c38c2d62b41f88a904 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a70fa3093f1549659e754a5dd552a32c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 11:47:14.844002 5545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25417386718d46c38c2d62b41f88a904. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:14.845135 5674 tablet_bootstrap.cc:492] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: Bootstrap starting.
I20260806 11:47:14.846378 5674 tablet_bootstrap.cc:654] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:14.846426 5676 tablet_bootstrap.cc:492] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: No bootstrap required, opened a new log
I20260806 11:47:14.846529 5676 ts_tablet_manager.cc:1397] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 11:47:14.847144 5676 raft_consensus.cc:348] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.847296 5676 raft_consensus.cc:374] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:14.847335 5676 raft_consensus.cc:729] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1435d096e334cff8a09afe7c6b5cf2a, State: Initialized, Role: FOLLOWER
I20260806 11:47:14.847520 5676 consensus_queue.cc:260] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.847868 5676 ts_tablet_manager.cc:1428] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 11:47:14.848083 5685 tablet_replica.cc:439] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } }
I20260806 11:47:14.848553 5685 tablet_replica.cc:442] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:47:14.850847 5674 tablet_bootstrap.cc:492] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: No bootstrap required, opened a new log
I20260806 11:47:14.850955 5675 tablet_bootstrap.cc:492] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: Bootstrap starting.
I20260806 11:47:14.850975 5674 ts_tablet_manager.cc:1397] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260806 11:47:14.851521 5674 raft_consensus.cc:348] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.851670 5674 raft_consensus.cc:374] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:14.851703 5674 raft_consensus.cc:729] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15353e188bfa42028e31a5a1b2bcef2f, State: Initialized, Role: FOLLOWER
I20260806 11:47:14.851856 5674 consensus_queue.cc:260] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.852151 5675 tablet_bootstrap.cc:654] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:14.852205 5674 ts_tablet_manager.cc:1428] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 11:47:14.852258 5683 tablet_replica.cc:439] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } }
I20260806 11:47:14.852535 5683 tablet_replica.cc:442] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:47:14.854202 5675 tablet_bootstrap.cc:492] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: No bootstrap required, opened a new log
I20260806 11:47:14.854337 5675 ts_tablet_manager.cc:1397] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 11:47:14.854812 5675 raft_consensus.cc:348] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.855023 5675 raft_consensus.cc:374] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:14.855064 5675 raft_consensus.cc:729] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62471ee08c29476191b956552b3f6b39, State: Initialized, Role: FOLLOWER
I20260806 11:47:14.855216 5675 consensus_queue.cc:260] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.855511 5675 ts_tablet_manager.cc:1428] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260806 11:47:14.855743 5684 tablet_replica.cc:439] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } }
I20260806 11:47:14.855901 5684 tablet_replica.cc:442] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:47:14.950157 5684 raft_consensus.cc:482] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:47:14.950438 5684 raft_consensus.cc:504] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.951017 5684 leader_election.cc:288] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447), a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391)
I20260806 11:47:14.951787 5380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25417386718d46c38c2d62b41f88a904" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" is_pre_election: true
I20260806 11:47:14.951787 5170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25417386718d46c38c2d62b41f88a904" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15353e188bfa42028e31a5a1b2bcef2f" is_pre_election: true
I20260806 11:47:14.952051 5380 raft_consensus.cc:2454] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 0.
I20260806 11:47:14.952051 5170 raft_consensus.cc:2454] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 0.
I20260806 11:47:14.952456 5480 leader_election.cc:302] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62471ee08c29476191b956552b3f6b39, a1435d096e334cff8a09afe7c6b5cf2a; no voters:
I20260806 11:47:14.952684 5684 raft_consensus.cc:2781] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:47:14.952762 5684 raft_consensus.cc:482] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:47:14.952809 5684 raft_consensus.cc:3037] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:14.953982 5684 raft_consensus.cc:504] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.954481 5684 leader_election.cc:288] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 election: Requested vote from peers 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447), a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391)
I20260806 11:47:14.955046 5170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25417386718d46c38c2d62b41f88a904" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15353e188bfa42028e31a5a1b2bcef2f"
I20260806 11:47:14.955228 5170 raft_consensus.cc:3037] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:14.955134 5380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25417386718d46c38c2d62b41f88a904" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1435d096e334cff8a09afe7c6b5cf2a"
I20260806 11:47:14.955416 5380 raft_consensus.cc:3037] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:14.956436 5170 raft_consensus.cc:2454] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 1.
I20260806 11:47:14.956820 5380 raft_consensus.cc:2454] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 1.
I20260806 11:47:14.956936 5480 leader_election.cc:302] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15353e188bfa42028e31a5a1b2bcef2f, 62471ee08c29476191b956552b3f6b39; no voters:
I20260806 11:47:14.957201 5684 raft_consensus.cc:2781] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:14.957310 5684 raft_consensus.cc:686] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [term 1 LEADER]: Becoming Leader. State: Replica: 62471ee08c29476191b956552b3f6b39, State: Running, Role: LEADER
I20260806 11:47:14.957491 5684 consensus_queue.cc:237] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:14.958930 5697 tablet_replica.cc:439] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: TxnStatusTablet state changed. Reason: New leader 62471ee08c29476191b956552b3f6b39. Latest consensus state: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } }
I20260806 11:47:14.959124 5697 tablet_replica.cc:442] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: This TxnStatusTablet replica's current role is: LEADER
I20260806 11:47:14.959455 5729 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 11:47:14.959717 5729 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 11:47:14.960487 4962 catalog_manager.cc:5495] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62471ee08c29476191b956552b3f6b39 (127.26.172.195). New cstate: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260806 11:47:14.990015 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.985805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38732 (local address 127.26.172.195:32927)
0806 11:47:14.985978 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:14.985984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:14.986002 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:47:14.986094 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:14.986099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:14.986160 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:14.986250 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:47:14.986542 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.987235 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.988463 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.988713 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.988866 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.989333 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:47:14.989460 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:47:14.989596 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:14.989742 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 11:47:14.989811 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 11:47:14.989987 5724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:14.985636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:32927 (local address 127.0.0.1:38732)
0806 11:47:14.985809 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:14.985828 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:14.985964 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:14.986279 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:14.986282 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:14.986290 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:47:14.986411 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.986416 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.987354 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.987359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.988173 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:14.988185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:14.988928 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:14.988937 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:14.989055 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:14.989141 (+ 86us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:47:14.989593 (+ 452us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:47:14.989616 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 11:47:14.989716 (+ 100us) client_negotiation.cc:240] Negotiation successful
0806 11:47:14.989827 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 11:47:14.994045 5170 raft_consensus.cc:1261] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Refusing update from remote peer 62471ee08c29476191b956552b3f6b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:14.994184 5380 raft_consensus.cc:1261] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Refusing update from remote peer 62471ee08c29476191b956552b3f6b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:14.994620 5697 consensus_queue.cc:1035] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:14.994874 5684 consensus_queue.cc:1035] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:14.996805 5683 tablet_replica.cc:439] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: TxnStatusTablet state changed. Reason: New leader 62471ee08c29476191b956552b3f6b39. Latest consensus state: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } }
I20260806 11:47:14.996894 5685 tablet_replica.cc:439] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: TxnStatusTablet state changed. Reason: New leader 62471ee08c29476191b956552b3f6b39. Latest consensus state: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } }
I20260806 11:47:14.996985 5683 tablet_replica.cc:442] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:47:14.997017 5685 tablet_replica.cc:442] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:47:14.999769 5697 tablet_replica.cc:439] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } }
I20260806 11:47:14.999943 5697 tablet_replica.cc:442] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: This TxnStatusTablet replica's current role is: LEADER
I20260806 11:47:15.000123 5697 tablet_replica.cc:439] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } }
I20260806 11:47:15.000208 5697 tablet_replica.cc:442] T 25417386718d46c38c2d62b41f88a904 P 62471ee08c29476191b956552b3f6b39: This TxnStatusTablet replica's current role is: LEADER
I20260806 11:47:15.000138 5683 tablet_replica.cc:439] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } }
I20260806 11:47:15.000252 5683 tablet_replica.cc:442] T 25417386718d46c38c2d62b41f88a904 P 15353e188bfa42028e31a5a1b2bcef2f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:47:15.003047 5685 tablet_replica.cc:439] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } } }
I20260806 11:47:15.003219 5685 tablet_replica.cc:442] T 25417386718d46c38c2d62b41f88a904 P a1435d096e334cff8a09afe7c6b5cf2a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 11:47:15.012634 5667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:15.007350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44598 (local address 127.26.172.194:34391)
0806 11:47:15.007476 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:15.007480 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:15.007683 (+ 203us) server_negotiation.cc:407] Connection header received
0806 11:47:15.007816 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:15.007819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:15.007885 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:15.008051 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:47:15.008409 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.009151 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.010641 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.011044 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.011169 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:15.011541 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:47:15.012147 (+ 606us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:47:15.012279 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:15.012410 (+ 131us) server_negotiation.cc:299] Negotiation successful
0806 11:47:15.012483 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 11:47:15.032238 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:15.025424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:46773 (local address 127.26.172.195:32927)
0806 11:47:15.025593 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:15.025598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:15.027339 (+ 1741us) server_negotiation.cc:407] Connection header received
0806 11:47:15.027504 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:15.027508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:15.027598 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:15.027740 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:47:15.028081 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.028948 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.030491 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.030983 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.031135 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:15.031607 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:47:15.031726 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:47:15.031811 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:15.031981 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 11:47:15.032064 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 11:47:15.032439 5738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:15.025314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:32927 (local address 127.26.172.194:46773)
0806 11:47:15.027156 (+ 1842us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:15.027178 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:15.027334 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:15.027770 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:15.027773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:15.027783 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:47:15.027920 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:15.027926 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.029138 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.029144 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:15.030248 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:15.030266 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.031185 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.031189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:15.031305 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:15.031405 (+ 100us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:47:15.031845 (+ 440us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:47:15.031857 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 11:47:15.031963 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 11:47:15.032086 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1693,"thread_start_us":176,"threads_started":1}
I20260806 11:47:15.043046 5170 raft_consensus.cc:1261] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Refusing update from remote peer a1435d096e334cff8a09afe7c6b5cf2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:15.043354 5571 raft_consensus.cc:1261] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Refusing update from remote peer a1435d096e334cff8a09afe7c6b5cf2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:15.043879 5711 consensus_queue.cc:1035] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:15.044379 5711 consensus_queue.cc:1035] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:15.055727 5690 mvcc.cc:205] Tried to move back new op lower bound from 7315524956329598976 to 7315524955194224640. Current Snapshot: MvccSnapshot[applied={T|T < 7315524956329598976}]
I20260806 11:47:15.076674 5745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:15.071876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:34391 (local address 127.26.172.195:58197)
0806 11:47:15.072299 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:15.072313 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:15.072415 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:15.072773 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:15.072775 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:15.072782 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:47:15.072892 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:15.072896 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.074177 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.074180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:15.075099 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:15.075109 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.075794 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.075798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:15.075877 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:15.075941 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:47:15.076376 (+ 435us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:47:15.076381 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 11:47:15.076443 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 11:47:15.076527 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":126,"threads_started":1}
I20260806 11:47:15.076761 5667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:15.071938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:58197 (local address 127.26.172.194:34391)
0806 11:47:15.072193 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:15.072200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:15.072409 (+ 209us) server_negotiation.cc:407] Connection header received
0806 11:47:15.072556 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:15.072560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:15.072645 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:15.072750 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:47:15.073021 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.073968 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.075256 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.075667 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.075800 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:15.076149 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:47:15.076274 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:47:15.076364 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:15.076461 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 11:47:15.076555 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 11:47:15.115316 4967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:15.115610 4967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:15.119009 4967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889: Sending DeleteTablet for 3 replicas of tablet 9fe8b8fa96d84cbb82c54530057a586d
I20260806 11:47:15.120185 5351 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe8b8fa96d84cbb82c54530057a586d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:15 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:44596
I20260806 11:47:15.120529 5703 tablet_replica.cc:330] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a: stopping tablet replica
I20260806 11:47:15.120673 5703 raft_consensus.cc:2229] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:47:15.121085 5703 raft_consensus.cc:2258] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:15.121858 5168 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe8b8fa96d84cbb82c54530057a586d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:15 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:55860
I20260806 11:47:15.122092 5704 tablet_replica.cc:330] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f: stopping tablet replica
I20260806 11:47:15.122231 5704 raft_consensus.cc:2229] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:15.122394 5704 raft_consensus.cc:2258] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:15.123243 5703 ts_tablet_manager.cc:1905] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:15.123580 5704 ts_tablet_manager.cc:1905] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:15.126681 5703 ts_tablet_manager.cc:1918] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:47:15.126773 5703 log.cc:1196] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/9fe8b8fa96d84cbb82c54530057a586d
I20260806 11:47:15.127560 5545 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe8b8fa96d84cbb82c54530057a586d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:15 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:38712
I20260806 11:47:15.127581 5704 ts_tablet_manager.cc:1918] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:47:15.127704 5704 log.cc:1196] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/9fe8b8fa96d84cbb82c54530057a586d
I20260806 11:47:15.127776 5705 tablet_replica.cc:330] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39: stopping tablet replica
I20260806 11:47:15.127904 5705 raft_consensus.cc:2229] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:15.128027 5704 ts_tablet_manager.cc:1939] T 9fe8b8fa96d84cbb82c54530057a586d P 15353e188bfa42028e31a5a1b2bcef2f: Deleting consensus metadata
I20260806 11:47:15.128029 5705 raft_consensus.cc:2258] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:15.128921 5705 ts_tablet_manager.cc:1905] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:15.131063 4945 catalog_manager.cc:4841] TS 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447): tablet 9fe8b8fa96d84cbb82c54530057a586d (table test-table [id=175e642454044b2ab5aa00d866e46e42]) successfully deleted
I20260806 11:47:15.132097 5705 ts_tablet_manager.cc:1918] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:47:15.132324 5703 ts_tablet_manager.cc:1939] T 9fe8b8fa96d84cbb82c54530057a586d P a1435d096e334cff8a09afe7c6b5cf2a: Deleting consensus metadata
I20260806 11:47:15.134145 4945 catalog_manager.cc:4841] TS a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391): tablet 9fe8b8fa96d84cbb82c54530057a586d (table test-table [id=175e642454044b2ab5aa00d866e46e42]) successfully deleted
I20260806 11:47:15.137460 5705 log.cc:1196] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/9fe8b8fa96d84cbb82c54530057a586d
I20260806 11:47:15.137924 5705 ts_tablet_manager.cc:1939] T 9fe8b8fa96d84cbb82c54530057a586d P 62471ee08c29476191b956552b3f6b39: Deleting consensus metadata
I20260806 11:47:15.138964 4946 catalog_manager.cc:4841] TS 62471ee08c29476191b956552b3f6b39 (127.26.172.195:32927): tablet 9fe8b8fa96d84cbb82c54530057a586d (table test-table [id=175e642454044b2ab5aa00d866e46e42]) successfully deleted
Aug 06 11:47:15 dist-test-slave-7z32 krb5kdc[4908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 11:47:15 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:15 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
W20260806 11:47:15.177057 5037 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:15.166562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40002 (local address 127.26.172.254:44265)
0806 11:47:15.166741 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:15.166747 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:15.167111 (+ 364us) server_negotiation.cc:407] Connection header received
0806 11:47:15.167379 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:15.167383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:15.167463 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:15.167590 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:15.168837 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.169703 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.171366 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.171738 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.171865 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:15.176866 (+ 5001us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40002: BlockingRecv error: recv got EOF from 127.0.0.1:40002 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 06 11:47:15 dist-test-slave-7z32 krb5kdc[4908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM
I20260806 11:47:15.192060 5037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:15.179153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40012 (local address 127.26.172.254:44265)
0806 11:47:15.179307 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:15.179312 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:15.179622 (+ 310us) server_negotiation.cc:407] Connection header received
0806 11:47:15.179782 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:15.179785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:15.179851 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:15.179945 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:15.181089 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.181696 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.183303 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.183606 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.183730 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:15.187932 (+ 4202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:15.187937 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:15.187939 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:15.187984 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:15.189835 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:15.190407 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:15.190412 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:15.190414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:15.190510 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:15.190895 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:15.190899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:15.190901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:15.191238 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:15.191397 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:15.191703 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 11:47:15.191849 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 11:47:15.196318 4967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40012:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:47:15.196977 4967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:47:15.203991 5351 tablet_service.cc:1467] Processing CreateTablet for tablet 626fe348f31a43ae99c32addbea0ba88 (DEFAULT_TABLE table=test-table [id=4ad49a710bf641f0a17bb424bf57e9e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:15.204403 5351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 626fe348f31a43ae99c32addbea0ba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:15.204355 5545 tablet_service.cc:1467] Processing CreateTablet for tablet 626fe348f31a43ae99c32addbea0ba88 (DEFAULT_TABLE table=test-table [id=4ad49a710bf641f0a17bb424bf57e9e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:15.204797 5545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 626fe348f31a43ae99c32addbea0ba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:15.204849 5168 tablet_service.cc:1467] Processing CreateTablet for tablet 626fe348f31a43ae99c32addbea0ba88 (DEFAULT_TABLE table=test-table [id=4ad49a710bf641f0a17bb424bf57e9e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:15.205185 5168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 626fe348f31a43ae99c32addbea0ba88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:15.207293 5676 tablet_bootstrap.cc:492] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a: Bootstrap starting.
I20260806 11:47:15.208765 5676 tablet_bootstrap.cc:654] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:15.208870 5674 tablet_bootstrap.cc:492] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f: Bootstrap starting.
I20260806 11:47:15.209949 5674 tablet_bootstrap.cc:654] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:15.210462 5676 tablet_bootstrap.cc:492] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a: No bootstrap required, opened a new log
I20260806 11:47:15.210602 5676 ts_tablet_manager.cc:1397] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260806 11:47:15.210768 5675 tablet_bootstrap.cc:492] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39: Bootstrap starting.
I20260806 11:47:15.211369 5676 raft_consensus.cc:348] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.211534 5676 raft_consensus.cc:374] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:15.211572 5676 raft_consensus.cc:729] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1435d096e334cff8a09afe7c6b5cf2a, State: Initialized, Role: FOLLOWER
I20260806 11:47:15.211787 5675 tablet_bootstrap.cc:654] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:15.211766 5676 consensus_queue.cc:260] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.212085 5676 ts_tablet_manager.cc:1428] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 11:47:15.213339 5675 tablet_bootstrap.cc:492] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39: No bootstrap required, opened a new log
I20260806 11:47:15.213481 5675 ts_tablet_manager.cc:1397] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260806 11:47:15.213989 5675 raft_consensus.cc:348] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.214130 5675 raft_consensus.cc:374] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:15.214164 5675 raft_consensus.cc:729] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62471ee08c29476191b956552b3f6b39, State: Initialized, Role: FOLLOWER
I20260806 11:47:15.214658 5675 consensus_queue.cc:260] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.215039 5675 ts_tablet_manager.cc:1428] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 11:47:15.215142 5674 tablet_bootstrap.cc:492] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f: No bootstrap required, opened a new log
I20260806 11:47:15.215312 5674 ts_tablet_manager.cc:1397] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260806 11:47:15.216033 5674 raft_consensus.cc:348] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.216198 5674 raft_consensus.cc:374] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:15.216260 5674 raft_consensus.cc:729] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15353e188bfa42028e31a5a1b2bcef2f, State: Initialized, Role: FOLLOWER
I20260806 11:47:15.216418 5674 consensus_queue.cc:260] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.216804 5674 ts_tablet_manager.cc:1428] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 11:47:15.286132 5684 raft_consensus.cc:482] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:47:15.286363 5684 raft_consensus.cc:504] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.287204 5684 leader_election.cc:288] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447), a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391)
I20260806 11:47:15.288012 5197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "626fe348f31a43ae99c32addbea0ba88" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15353e188bfa42028e31a5a1b2bcef2f" is_pre_election: true
I20260806 11:47:15.288272 5197 raft_consensus.cc:2454] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 0.
I20260806 11:47:15.288264 5380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "626fe348f31a43ae99c32addbea0ba88" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" is_pre_election: true
I20260806 11:47:15.288511 5380 raft_consensus.cc:2454] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 0.
I20260806 11:47:15.288735 5480 leader_election.cc:302] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15353e188bfa42028e31a5a1b2bcef2f, 62471ee08c29476191b956552b3f6b39; no voters:
I20260806 11:47:15.288956 5684 raft_consensus.cc:2781] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:47:15.289033 5684 raft_consensus.cc:482] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:47:15.289073 5684 raft_consensus.cc:3037] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:15.290553 5684 raft_consensus.cc:504] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.291105 5684 leader_election.cc:288] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 election: Requested vote from peers 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447), a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391)
I20260806 11:47:15.291711 5380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "626fe348f31a43ae99c32addbea0ba88" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1435d096e334cff8a09afe7c6b5cf2a"
I20260806 11:47:15.291756 5197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "626fe348f31a43ae99c32addbea0ba88" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15353e188bfa42028e31a5a1b2bcef2f"
I20260806 11:47:15.291893 5380 raft_consensus.cc:3037] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:15.292002 5197 raft_consensus.cc:3037] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:15.293136 5380 raft_consensus.cc:2454] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 1.
I20260806 11:47:15.293546 5197 raft_consensus.cc:2454] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 1.
I20260806 11:47:15.293548 5480 leader_election.cc:302] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62471ee08c29476191b956552b3f6b39, a1435d096e334cff8a09afe7c6b5cf2a; no voters:
I20260806 11:47:15.293782 5684 raft_consensus.cc:2781] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:15.293928 5684 raft_consensus.cc:686] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 1 LEADER]: Becoming Leader. State: Replica: 62471ee08c29476191b956552b3f6b39, State: Running, Role: LEADER
I20260806 11:47:15.294106 5684 consensus_queue.cc:237] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.296443 4967 catalog_manager.cc:5495] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62471ee08c29476191b956552b3f6b39 (127.26.172.195). New cstate: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260806 11:47:15.312314 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:15.307125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38742 (local address 127.26.172.195:32927)
0806 11:47:15.307332 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:15.307338 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:15.307360 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:47:15.307441 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:15.307445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:15.307534 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:15.307674 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:47:15.308031 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.308935 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.310458 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.310909 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.311047 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:15.311652 (+ 605us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:47:15.311767 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:47:15.311848 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:15.312057 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 11:47:15.312136 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 11:47:15.315346 5197 raft_consensus.cc:1261] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Refusing update from remote peer 62471ee08c29476191b956552b3f6b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:15.315395 5380 raft_consensus.cc:1261] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Refusing update from remote peer 62471ee08c29476191b956552b3f6b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:15.316087 5684 consensus_queue.cc:1035] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:15.316394 5697 consensus_queue.cc:1035] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:15.328353 4962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:15.328603 4962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:15.331528 4962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889: Sending DeleteTablet for 3 replicas of tablet 626fe348f31a43ae99c32addbea0ba88
I20260806 11:47:15.332567 5168 tablet_service.cc:1514] Processing DeleteTablet for tablet 626fe348f31a43ae99c32addbea0ba88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:15 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:55860
I20260806 11:47:15.332890 5545 tablet_service.cc:1514] Processing DeleteTablet for tablet 626fe348f31a43ae99c32addbea0ba88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:15 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:38712
I20260806 11:47:15.333160 5705 tablet_replica.cc:330] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39: stopping tablet replica
I20260806 11:47:15.333216 5351 tablet_service.cc:1514] Processing DeleteTablet for tablet 626fe348f31a43ae99c32addbea0ba88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:15 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:44596
I20260806 11:47:15.333338 5705 raft_consensus.cc:2229] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:47:15.333511 5703 tablet_replica.cc:330] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a: stopping tablet replica
I20260806 11:47:15.333526 5704 tablet_replica.cc:330] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f: stopping tablet replica
I20260806 11:47:15.333602 5705 raft_consensus.cc:2258] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:15.333667 5704 raft_consensus.cc:2229] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:15.333668 5703 raft_consensus.cc:2229] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:15.333838 5704 raft_consensus.cc:2258] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:15.333843 5703 raft_consensus.cc:2258] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:15.334497 5705 ts_tablet_manager.cc:1905] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:15.334940 5704 ts_tablet_manager.cc:1905] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:15.334894 4962 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40012:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:47:15.335739 4962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:47:15.336877 5705 ts_tablet_manager.cc:1918] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:15.336972 5705 log.cc:1196] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/626fe348f31a43ae99c32addbea0ba88
I20260806 11:47:15.337201 5705 ts_tablet_manager.cc:1939] T 626fe348f31a43ae99c32addbea0ba88 P 62471ee08c29476191b956552b3f6b39: Deleting consensus metadata
I20260806 11:47:15.338133 5704 ts_tablet_manager.cc:1918] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:15.338845 5703 ts_tablet_manager.cc:1905] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:15.338970 5704 log.cc:1196] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/626fe348f31a43ae99c32addbea0ba88
I20260806 11:47:15.339094 4946 catalog_manager.cc:4841] TS 62471ee08c29476191b956552b3f6b39 (127.26.172.195:32927): tablet 626fe348f31a43ae99c32addbea0ba88 (table test-table [id=4ad49a710bf641f0a17bb424bf57e9e7]) successfully deleted
I20260806 11:47:15.339318 5704 ts_tablet_manager.cc:1939] T 626fe348f31a43ae99c32addbea0ba88 P 15353e188bfa42028e31a5a1b2bcef2f: Deleting consensus metadata
I20260806 11:47:15.340305 4945 catalog_manager.cc:4841] TS 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447): tablet 626fe348f31a43ae99c32addbea0ba88 (table test-table [id=4ad49a710bf641f0a17bb424bf57e9e7]) successfully deleted
I20260806 11:47:15.342146 5703 ts_tablet_manager.cc:1918] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:15.342371 5703 log.cc:1196] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/626fe348f31a43ae99c32addbea0ba88
I20260806 11:47:15.342789 5703 ts_tablet_manager.cc:1939] T 626fe348f31a43ae99c32addbea0ba88 P a1435d096e334cff8a09afe7c6b5cf2a: Deleting consensus metadata
I20260806 11:47:15.343430 5545 tablet_service.cc:1467] Processing CreateTablet for tablet 5752631590804ba5b8ab379d449d0984 (DEFAULT_TABLE table=test-table [id=5e6eec31dee048999986b54736c5e1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:15.343676 5351 tablet_service.cc:1467] Processing CreateTablet for tablet 5752631590804ba5b8ab379d449d0984 (DEFAULT_TABLE table=test-table [id=5e6eec31dee048999986b54736c5e1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:15.343819 5545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5752631590804ba5b8ab379d449d0984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:15.343817 4945 catalog_manager.cc:4841] TS a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391): tablet 626fe348f31a43ae99c32addbea0ba88 (table test-table [id=4ad49a710bf641f0a17bb424bf57e9e7]) successfully deleted
I20260806 11:47:15.344035 5351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5752631590804ba5b8ab379d449d0984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:15.346283 5675 tablet_bootstrap.cc:492] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39: Bootstrap starting.
I20260806 11:47:15.346889 5168 tablet_service.cc:1467] Processing CreateTablet for tablet 5752631590804ba5b8ab379d449d0984 (DEFAULT_TABLE table=test-table [id=5e6eec31dee048999986b54736c5e1af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:15.347272 5168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5752631590804ba5b8ab379d449d0984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:15.347615 5675 tablet_bootstrap.cc:654] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:15.349092 5675 tablet_bootstrap.cc:492] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39: No bootstrap required, opened a new log
I20260806 11:47:15.349225 5675 ts_tablet_manager.cc:1397] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 11:47:15.349762 5675 raft_consensus.cc:348] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.350023 5675 raft_consensus.cc:374] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:15.350111 5675 raft_consensus.cc:729] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62471ee08c29476191b956552b3f6b39, State: Initialized, Role: FOLLOWER
I20260806 11:47:15.350359 5675 consensus_queue.cc:260] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.351537 5676 tablet_bootstrap.cc:492] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a: Bootstrap starting.
I20260806 11:47:15.352698 5676 tablet_bootstrap.cc:654] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:15.352908 5675 ts_tablet_manager.cc:1428] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:15.354578 5676 tablet_bootstrap.cc:492] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a: No bootstrap required, opened a new log
I20260806 11:47:15.354693 5676 ts_tablet_manager.cc:1397] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 11:47:15.355211 5676 raft_consensus.cc:348] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.355331 5676 raft_consensus.cc:374] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:15.355358 5676 raft_consensus.cc:729] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1435d096e334cff8a09afe7c6b5cf2a, State: Initialized, Role: FOLLOWER
I20260806 11:47:15.355499 5676 consensus_queue.cc:260] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.355780 5676 ts_tablet_manager.cc:1428] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 11:47:15.356384 5674 tablet_bootstrap.cc:492] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f: Bootstrap starting.
I20260806 11:47:15.357573 5674 tablet_bootstrap.cc:654] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:15.359181 5674 tablet_bootstrap.cc:492] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f: No bootstrap required, opened a new log
I20260806 11:47:15.359282 5674 ts_tablet_manager.cc:1397] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 11:47:15.359777 5674 raft_consensus.cc:348] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.359908 5674 raft_consensus.cc:374] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:15.359937 5674 raft_consensus.cc:729] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15353e188bfa42028e31a5a1b2bcef2f, State: Initialized, Role: FOLLOWER
I20260806 11:47:15.360096 5674 consensus_queue.cc:260] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.360364 5674 ts_tablet_manager.cc:1428] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 11:47:15.455175 5697 raft_consensus.cc:482] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:47:15.455408 5697 raft_consensus.cc:504] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.456146 5697 leader_election.cc:288] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447), a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391)
I20260806 11:47:15.457182 5197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5752631590804ba5b8ab379d449d0984" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15353e188bfa42028e31a5a1b2bcef2f" is_pre_election: true
I20260806 11:47:15.457182 5380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5752631590804ba5b8ab379d449d0984" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" is_pre_election: true
I20260806 11:47:15.457484 5380 raft_consensus.cc:2454] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 0.
I20260806 11:47:15.457484 5197 raft_consensus.cc:2454] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 0.
I20260806 11:47:15.458011 5480 leader_election.cc:302] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62471ee08c29476191b956552b3f6b39, a1435d096e334cff8a09afe7c6b5cf2a; no voters:
I20260806 11:47:15.458305 5697 raft_consensus.cc:2781] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:47:15.458400 5697 raft_consensus.cc:482] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:47:15.458458 5697 raft_consensus.cc:3037] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:15.460043 5697 raft_consensus.cc:504] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.460583 5697 leader_election.cc:288] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 election: Requested vote from peers 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447), a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391)
I20260806 11:47:15.461318 5380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5752631590804ba5b8ab379d449d0984" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1435d096e334cff8a09afe7c6b5cf2a"
I20260806 11:47:15.461385 5197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5752631590804ba5b8ab379d449d0984" candidate_uuid: "62471ee08c29476191b956552b3f6b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15353e188bfa42028e31a5a1b2bcef2f"
I20260806 11:47:15.461536 5380 raft_consensus.cc:3037] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:15.461581 5197 raft_consensus.cc:3037] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:15.462709 5380 raft_consensus.cc:2454] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 1.
I20260806 11:47:15.463090 5197 raft_consensus.cc:2454] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62471ee08c29476191b956552b3f6b39 in term 1.
I20260806 11:47:15.463141 5480 leader_election.cc:302] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62471ee08c29476191b956552b3f6b39, a1435d096e334cff8a09afe7c6b5cf2a; no voters:
I20260806 11:47:15.463423 5697 raft_consensus.cc:2781] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:15.463603 5697 raft_consensus.cc:686] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 1 LEADER]: Becoming Leader. State: Replica: 62471ee08c29476191b956552b3f6b39, State: Running, Role: LEADER
I20260806 11:47:15.463819 5697 consensus_queue.cc:237] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } }
I20260806 11:47:15.466110 4967 catalog_manager.cc:5495] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 62471ee08c29476191b956552b3f6b39 (127.26.172.195). New cstate: current_term: 1 leader_uuid: "62471ee08c29476191b956552b3f6b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62471ee08c29476191b956552b3f6b39" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260806 11:47:15.516104 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:15.512255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:53355 (local address 127.26.172.195:32927)
0806 11:47:15.512434 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:15.512439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:15.512457 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:47:15.512676 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:15.512679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:15.512733 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:15.512816 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:47:15.513201 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.513751 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.515003 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.515236 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.515337 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:15.515630 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:47:15.515711 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:47:15.515773 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:15.515927 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 11:47:15.515981 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 11:47:15.516335 5745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:15.512098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:32927 (local address 127.26.172.195:53355)
0806 11:47:15.512329 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:15.512359 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:15.512480 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:15.512877 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:15.512880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:15.512887 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 11:47:15.513024 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:15.513029 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.513919 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.513923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:15.514788 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:15.514800 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:15.515377 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:15.515380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:15.515459 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:15.515499 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 11:47:15.515830 (+ 331us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 11:47:15.515837 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 11:47:15.515902 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 11:47:15.516106 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260806 11:47:15.525096 5380 raft_consensus.cc:1261] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Refusing update from remote peer 62471ee08c29476191b956552b3f6b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:15.525094 5197 raft_consensus.cc:1261] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Refusing update from remote peer 62471ee08c29476191b956552b3f6b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:15.525642 5743 consensus_queue.cc:1035] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1435d096e334cff8a09afe7c6b5cf2a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:15.525920 5697 consensus_queue.cc:1035] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15353e188bfa42028e31a5a1b2bcef2f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:15.570706 4962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:15.571146 4962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:15.574472 4962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbd00b6d5923456aa28813483a686889: Sending DeleteTablet for 3 replicas of tablet 5752631590804ba5b8ab379d449d0984
I20260806 11:47:15.575763 5168 tablet_service.cc:1514] Processing DeleteTablet for tablet 5752631590804ba5b8ab379d449d0984 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:15 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:55860
I20260806 11:47:15.575789 5545 tablet_service.cc:1514] Processing DeleteTablet for tablet 5752631590804ba5b8ab379d449d0984 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:15 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:38712
I20260806 11:47:15.575805 5351 tablet_service.cc:1514] Processing DeleteTablet for tablet 5752631590804ba5b8ab379d449d0984 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:15 UTC) from {username='oryx', principal='oryx/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:44596
I20260806 11:47:15.576064 5705 tablet_replica.cc:330] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39: stopping tablet replica
I20260806 11:47:15.576108 5703 tablet_replica.cc:330] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a: stopping tablet replica
I20260806 11:47:15.576121 5704 tablet_replica.cc:330] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f: stopping tablet replica
I20260806 11:47:15.576247 5705 raft_consensus.cc:2229] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:47:15.576256 5703 raft_consensus.cc:2229] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:15.576256 5704 raft_consensus.cc:2229] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:15.576411 5703 raft_consensus.cc:2258] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:15.576416 5704 raft_consensus.cc:2258] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:15.576545 5705 raft_consensus.cc:2258] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:15.577275 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 5068
I20260806 11:47:15.577461 5703 ts_tablet_manager.cc:1905] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:15.577620 5704 ts_tablet_manager.cc:1905] T 5752631590804ba5b8ab379d449d0984 P 15353e188bfa42028e31a5a1b2bcef2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:15.577723 5705 ts_tablet_manager.cc:1905] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:15.581303 5703 ts_tablet_manager.cc:1918] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:47:15.581437 5703 log.cc:1196] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/5752631590804ba5b8ab379d449d0984
I20260806 11:47:15.581781 5703 ts_tablet_manager.cc:1939] T 5752631590804ba5b8ab379d449d0984 P a1435d096e334cff8a09afe7c6b5cf2a: Deleting consensus metadata
I20260806 11:47:15.583194 4945 catalog_manager.cc:4841] TS a1435d096e334cff8a09afe7c6b5cf2a (127.26.172.194:34391): tablet 5752631590804ba5b8ab379d449d0984 (table test-table [id=5e6eec31dee048999986b54736c5e1af]) successfully deleted
I20260806 11:47:15.588385 5705 ts_tablet_manager.cc:1918] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 11:47:15.588608 5705 log.cc:1196] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/5752631590804ba5b8ab379d449d0984
I20260806 11:47:15.589067 5705 ts_tablet_manager.cc:1939] T 5752631590804ba5b8ab379d449d0984 P 62471ee08c29476191b956552b3f6b39: Deleting consensus metadata
I20260806 11:47:15.590237 4946 catalog_manager.cc:4841] TS 62471ee08c29476191b956552b3f6b39 (127.26.172.195:32927): tablet 5752631590804ba5b8ab379d449d0984 (table test-table [id=5e6eec31dee048999986b54736c5e1af]) successfully deleted
W20260806 11:47:15.597010 4945 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:39447 (error 108)
I20260806 11:47:15.597926 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 5267
I20260806 11:47:15.605747 5779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:15.598249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:39447 (local address 127.0.0.1:55864)
0806 11:47:15.605406 (+ 7157us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:15.605566 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:39447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6863,"thread_start_us":95,"threads_started":1}
W20260806 11:47:15.605953 4945 catalog_manager.cc:4584] TS 15353e188bfa42028e31a5a1b2bcef2f (127.26.172.193:39447): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5752631590804ba5b8ab379d449d0984: Network error: Client connection negotiation failed: client connection to 127.26.172.193:39447: connect: Connection refused (error 111)
I20260806 11:47:15.619310 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 5451
I20260806 11:47:15.639323 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 4923
2026-08-06T11:47:15Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3998 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:47:15 dist-test-slave-7z32 krb5kdc[5783](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:47:15 dist-test-slave-7z32 krb5kdc[5783](info): set up 2 sockets
Aug 06 11:47:15 dist-test-slave-7z32 krb5kdc[5783](info): commencing operation
krb5kdc: starting...
W20260806 11:47:16.999773 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.325s user 0.007s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:47:17 dist-test-slave-7z32 krb5kdc[5783](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:47:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:47:17.181077 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:39605
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:41111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:39605
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:17.312522 5800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:17.312933 5800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:17.313015 5800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:17.317286 5800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:17.317420 5800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:17.317457 5800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:17.317498 5800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:17.317567 5800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:17.323519 5800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:41111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:39605
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:39605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:17.324970 5800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:17.326220 5800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:17.337604 5810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:17.337808 5800 server_base.cc:1034] running on GCE node
W20260806 11:47:17.337677 5808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:17.337695 5806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:17.338759 5800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:17.340293 5800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:17.341645 5800 hybrid_clock.cc:648] HybridClock initialized: now 1786016837341636 us; error 85 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T11:47:17Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1703 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:47:17 dist-test-slave-7z32 krb5kdc[5818](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:47:17 dist-test-slave-7z32 krb5kdc[5818](info): set up 2 sockets
Aug 06 11:47:17 dist-test-slave-7z32 krb5kdc[5818](info): commencing operation
krb5kdc: starting...
W20260806 11:47:18.682343 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:47:18 dist-test-slave-7z32 krb5kdc[5818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:47:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:47:18.864835 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:34543
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:34543
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:19.029274 5839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:19.029706 5839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:19.029754 5839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:19.034490 5839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:19.034622 5839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:19.034646 5839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:19.034665 5839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:19.034684 5839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:19.041568 5839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:34543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:34543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:19.043413 5839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:19.044894 5839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 11:47:19.057192 5839 server_base.cc:1034] running on GCE node
W20260806 11:47:19.056998 5850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:19.056998 5847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:19.056998 5846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:19.058463 5839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:19.060335 5839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:19.061633 5839 hybrid_clock.cc:648] HybridClock initialized: now 1786016839061584 us; error 68 us; skew 500 ppm
Aug 06 11:47:19 dist-test-slave-7z32 krb5kdc[5818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016839, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:19.069998 5839 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:47:19.071697 5839 webserver.cc:460] Webserver started at http://127.26.172.254:37719/ using document root <none> and password file <none>
I20260806 11:47:19.072556 5839 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:19.072703 5839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:19.073035 5839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:19.076032 5839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "43ce0e17dc1c41149161f0b638642233"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "447b4e245cca2ac650750edafa5baf71"
server_key_iv: "9b98b9394774b7f02fdd17a9cd086571"
server_key_version: "encryptionkey@0"
I20260806 11:47:19.076795 5839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "43ce0e17dc1c41149161f0b638642233"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "447b4e245cca2ac650750edafa5baf71"
server_key_iv: "9b98b9394774b7f02fdd17a9cd086571"
server_key_version: "encryptionkey@0"
I20260806 11:47:19.082543 5839 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:47:19.087033 5862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:19.089329 5839 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:47:19.089638 5839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "43ce0e17dc1c41149161f0b638642233"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "447b4e245cca2ac650750edafa5baf71"
server_key_iv: "9b98b9394774b7f02fdd17a9cd086571"
server_key_version: "encryptionkey@0"
I20260806 11:47:19.089840 5839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:19.114248 5839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:19.119716 5839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:19.120023 5839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:19.131263 5839 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:34543
I20260806 11:47:19.131359 5927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:34543 every 8 connection(s)
I20260806 11:47:19.133121 5839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:19.137271 5928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:19.137563 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 5839
I20260806 11:47:19.137723 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:19.138121 27315 external_mini_cluster.cc:1428] Setting key 6e51640e76e000ec7a5f24f0d071855b
I20260806 11:47:19.145727 5928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: Bootstrap starting.
I20260806 11:47:19.149186 5928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:19.150188 5928 log.cc:824] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: Log is configured to *not* fsync() on all Append() calls
Aug 06 11:47:19 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:47:19.152998 5928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: No bootstrap required, opened a new log
I20260806 11:47:19.158377 5928 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } }
I20260806 11:47:19.158737 5928 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:19.158802 5928 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce0e17dc1c41149161f0b638642233, State: Initialized, Role: FOLLOWER
I20260806 11:47:19.159448 5931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:19.140405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49082 (local address 127.26.172.254:34543)
0806 11:47:19.141134 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:19.141161 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:19.141221 (+ 60us) server_negotiation.cc:407] Connection header received
0806 11:47:19.142176 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:19.142204 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:19.142717 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:19.143182 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:19.144469 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:19.145991 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:19.147457 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:19.148411 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:19.148651 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:19.152185 (+ 3534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:19.152193 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:19.152213 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:19.152254 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:19.154612 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:19.155473 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:19.155480 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:19.155488 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:19.155707 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:19.156155 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:19.156159 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:19.156161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:19.156830 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:19.157092 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:19.157772 (+ 680us) server_negotiation.cc:299] Negotiation successful
0806 11:47:19.158188 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":194,"threads_started":1}
I20260806 11:47:19.159413 5928 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } }
I20260806 11:47:19.159587 5928 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:19.159649 5928 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:19.159746 5928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:19.161135 5928 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } }
I20260806 11:47:19.161584 5928 leader_election.cc:302] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43ce0e17dc1c41149161f0b638642233; no voters:
I20260806 11:47:19.162032 5928 leader_election.cc:288] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:19.162122 5934 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:19.162396 5934 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 1 LEADER]: Becoming Leader. State: Replica: 43ce0e17dc1c41149161f0b638642233, State: Running, Role: LEADER
I20260806 11:47:19.163324 5934 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } }
I20260806 11:47:19.163710 5928 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:19.165627 5935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43ce0e17dc1c41149161f0b638642233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } } }
I20260806 11:47:19.166033 5935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:19.166795 5937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43ce0e17dc1c41149161f0b638642233. Latest consensus state: current_term: 1 leader_uuid: "43ce0e17dc1c41149161f0b638642233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } } }
I20260806 11:47:19.166996 5937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [sys.catalog]: This master's current role is: LEADER
W20260806 11:47:19.169806 5951 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:47:19.169965 5951 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:47:19.170145 5952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:19.171540 5952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:19.180717 5952 catalog_manager.cc:1347] Generated new cluster ID: 59465ee979e74b5abab267ecf80a1523
I20260806 11:47:19.180863 5952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:19.200928 5952 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:19.202219 5952 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:19.215183 5952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: Generated new TSK 0
I20260806 11:47:19.216672 5952 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:47:19.272475 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34543
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:19.430754 5959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:19.431167 5959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:19.431218 5959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:19.435952 5959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:19.436050 5959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:19.436117 5959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:47:19.442209 5959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:19.443528 5959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:19.444706 5959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:19.456849 5969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:19.456856 5965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:19.456899 5966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:19.456929 5959 server_base.cc:1034] running on GCE node
I20260806 11:47:19.458312 5959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:19.459390 5959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:19.460676 5959 hybrid_clock.cc:648] HybridClock initialized: now 1786016839460641 us; error 54 us; skew 500 ppm
Aug 06 11:47:19 dist-test-slave-7z32 krb5kdc[5818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016839, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:19.465056 5959 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:47:19.466624 5959 webserver.cc:460] Webserver started at http://127.26.172.193:46127/ using document root <none> and password file <none>
I20260806 11:47:19.467579 5959 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:19.467669 5959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:19.467976 5959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:19.470913 5959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "ee82fcf647a94956a72df7ad8d2ecdd5"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "f632c35a2a374e9ac75a224698e7078b"
server_key_iv: "788e4def4e5dfddd670932553e4e12fa"
server_key_version: "encryptionkey@0"
I20260806 11:47:19.471748 5959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "ee82fcf647a94956a72df7ad8d2ecdd5"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "f632c35a2a374e9ac75a224698e7078b"
server_key_iv: "788e4def4e5dfddd670932553e4e12fa"
server_key_version: "encryptionkey@0"
I20260806 11:47:19.478720 5959 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260806 11:47:19.483444 5977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:19.486539 5959 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:47:19.486987 5959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "ee82fcf647a94956a72df7ad8d2ecdd5"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "f632c35a2a374e9ac75a224698e7078b"
server_key_iv: "788e4def4e5dfddd670932553e4e12fa"
server_key_version: "encryptionkey@0"
I20260806 11:47:19.487221 5959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:19.508752 5959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:19.515066 5959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:19.515425 5959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:19.516374 5959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:19.517699 5959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:19.517793 5959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:19.517885 5959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:19.517932 5959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:19.532212 5959 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:45043
I20260806 11:47:19.532298 6118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:45043 every 8 connection(s)
I20260806 11:47:19.533645 5959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:47:19.534468 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 5959
I20260806 11:47:19.534672 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:47:19.535157 27315 external_mini_cluster.cc:1428] Setting key dc18e970001d64b0ed70086cb2cd2da1
Aug 06 11:47:19 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016839, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:47:19.555913 5931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:19.536506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:34551 (local address 127.26.172.254:34543)
0806 11:47:19.536681 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:19.536685 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:19.538333 (+ 1648us) server_negotiation.cc:407] Connection header received
0806 11:47:19.540229 (+ 1896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:19.540237 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:19.540350 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:19.540538 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:19.542350 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:19.543494 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:19.545196 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:19.545661 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:19.545860 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:19.549988 (+ 4128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:19.549996 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:19.550001 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:19.550063 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:19.552432 (+ 2369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:19.553312 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:19.553316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:19.553317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:19.553443 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:19.554106 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:19.554110 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:19.554111 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:19.554388 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:19.554501 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:19.555398 (+ 897us) server_negotiation.cc:299] Negotiation successful
0806 11:47:19.555669 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:47:19.556854 6122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:19.537163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:34551)
0806 11:47:19.537845 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:19.537913 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:19.539863 (+ 1950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:19.540825 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:19.540836 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:19.541321 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:19.542046 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:19.542066 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:19.543761 (+ 1695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:19.543765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:19.544950 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:19.544968 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:19.545938 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:19.545941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:19.546146 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:19.547110 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:19.547130 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:19.549643 (+ 2513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:19.552680 (+ 3037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:19.552688 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:19.552708 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:19.553127 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:19.553712 (+ 585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:19.553719 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:19.553724 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:19.553970 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:19.554520 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:19.554526 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:19.554949 (+ 423us) client_negotiation.cc:769] Sending connection context
0806 11:47:19.555268 (+ 319us) client_negotiation.cc:240] Negotiation successful
0806 11:47:19.555632 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":214,"threads_started":1}
I20260806 11:47:19.558964 6119 heartbeater.cc:347] Connected to a master server at 127.26.172.254:34543
I20260806 11:47:19.559310 6119 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:19.560019 6119 heartbeater.cc:511] Master 127.26.172.254:34543 requested a full tablet report, sending...
I20260806 11:47:19.562477 5882 ts_manager.cc:194] Registered new tserver with Master: ee82fcf647a94956a72df7ad8d2ecdd5 (127.26.172.193:45043)
I20260806 11:47:19.564405 5882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:34551
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:47:19.584710 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34543
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:19.752352 6125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:19.752795 6125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:19.752892 6125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:19.757905 6125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:19.758028 6125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:19.758102 6125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:47:19.765355 6125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:19.767220 6125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:19.768745 6125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:19.782527 6131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:19.782527 6134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:19.782665 6136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:19.783030 6125 server_base.cc:1034] running on GCE node
I20260806 11:47:19.783648 6125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:19.784713 6125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:19.786029 6125 hybrid_clock.cc:648] HybridClock initialized: now 1786016839785992 us; error 70 us; skew 500 ppm
Aug 06 11:47:19 dist-test-slave-7z32 krb5kdc[5818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016839, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:19.790705 6125 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:47:19.792353 6125 webserver.cc:460] Webserver started at http://127.26.172.194:40973/ using document root <none> and password file <none>
I20260806 11:47:19.793248 6125 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:19.793341 6125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:19.793601 6125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:19.796864 6125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "17c1f514c8f545f1989db73d1d21a280"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "07e0139288e9d8931466e786b04a8667"
server_key_iv: "331858970c679a0de2c2953356aa6424"
server_key_version: "encryptionkey@0"
I20260806 11:47:19.797745 6125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "17c1f514c8f545f1989db73d1d21a280"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "07e0139288e9d8931466e786b04a8667"
server_key_iv: "331858970c679a0de2c2953356aa6424"
server_key_version: "encryptionkey@0"
I20260806 11:47:19.803969 6125 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 11:47:19.809088 6144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:19.811791 6125 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:47:19.812088 6125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "17c1f514c8f545f1989db73d1d21a280"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "07e0139288e9d8931466e786b04a8667"
server_key_iv: "331858970c679a0de2c2953356aa6424"
server_key_version: "encryptionkey@0"
I20260806 11:47:19.812319 6125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:19.834179 6125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:19.839920 6125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:19.840452 6125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:19.841408 6125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:19.842731 6125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:19.842826 6125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:19.842938 6125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:19.842988 6125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:19.858139 6125 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:41343
I20260806 11:47:19.858243 6290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:41343 every 8 connection(s)
I20260806 11:47:19.859784 6125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:47:19.868880 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 6125
I20260806 11:47:19.869027 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:47:19.869441 27315 external_mini_cluster.cc:1428] Setting key 2dca39b8a2c3f2b93e4ccdac9a60ac4d
Aug 06 11:47:19 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016839, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:47:19.883231 5931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:19.862746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:42251 (local address 127.26.172.254:34543)
0806 11:47:19.863051 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:19.863056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:19.864459 (+ 1403us) server_negotiation.cc:407] Connection header received
0806 11:47:19.866356 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:19.866361 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:19.866443 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:19.866619 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:19.868551 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:19.869309 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:19.871620 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:19.872081 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:19.872245 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:19.876044 (+ 3799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:19.876049 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:19.876052 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:19.876090 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:19.878193 (+ 2103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:19.879608 (+ 1415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:19.879613 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:19.879614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:19.879805 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:19.880800 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:19.880806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:19.880807 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:19.881242 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:19.881368 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:19.882615 (+ 1247us) server_negotiation.cc:299] Negotiation successful
0806 11:47:19.882785 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161}
I20260806 11:47:19.884596 6293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:19.863355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:42251)
0806 11:47:19.864170 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:19.864239 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:19.866006 (+ 1767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:19.866967 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:19.866979 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:19.867595 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:19.868271 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:19.868290 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:19.869557 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:19.869561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:19.871353 (+ 1792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:19.871375 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:19.872390 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:19.872394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:19.872645 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:19.873547 (+ 902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:19.873571 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:19.875703 (+ 2132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:19.878558 (+ 2855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:19.878573 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:19.878609 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:19.879317 (+ 708us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:19.879966 (+ 649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:19.879973 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:19.879978 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:19.880389 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:19.881431 (+ 1042us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:19.881444 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:19.881940 (+ 496us) client_negotiation.cc:769] Sending connection context
0806 11:47:19.882429 (+ 489us) client_negotiation.cc:240] Negotiation successful
0806 11:47:19.883073 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":221,"threads_started":1}
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:47:19.887418 6291 heartbeater.cc:347] Connected to a master server at 127.26.172.254:34543
I20260806 11:47:19.887794 6291 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:19.888609 6291 heartbeater.cc:511] Master 127.26.172.254:34543 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:47:19.890471 5882 ts_manager.cc:194] Registered new tserver with Master: 17c1f514c8f545f1989db73d1d21a280 (127.26.172.194:41343)
I20260806 11:47:19.891404 5882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:42251
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:47:19.919852 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34543
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:20.077555 6296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:20.077912 6296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:20.077963 6296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:20.083282 6296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:20.083384 6296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:20.083460 6296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:47:20.090229 6296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:34543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:20.091876 6296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:20.093334 6296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:20.109086 6307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:20.109122 6303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:20.109136 6304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:20.109195 6296 server_base.cc:1034] running on GCE node
I20260806 11:47:20.110520 6296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:20.111747 6296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:20.115295 6296 hybrid_clock.cc:648] HybridClock initialized: now 1786016840115231 us; error 67 us; skew 500 ppm
Aug 06 11:47:20 dist-test-slave-7z32 krb5kdc[5818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016840, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:20.119534 6296 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:47:20.121184 6296 webserver.cc:460] Webserver started at http://127.26.172.195:37641/ using document root <none> and password file <none>
I20260806 11:47:20.121958 6296 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:20.122051 6296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:20.122285 6296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:20.125031 6296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "78802a02133e4d9ab031d9a6a62244e0"
format_stamp: "Formatted at 2026-08-06 11:47:20 on dist-test-slave-7z32"
server_key: "962db7c32bbd8bfb29ad80c736218086"
server_key_iv: "4e29a88bea35e6dcbb17a1bb5be057cb"
server_key_version: "encryptionkey@0"
I20260806 11:47:20.125774 6296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "78802a02133e4d9ab031d9a6a62244e0"
format_stamp: "Formatted at 2026-08-06 11:47:20 on dist-test-slave-7z32"
server_key: "962db7c32bbd8bfb29ad80c736218086"
server_key_iv: "4e29a88bea35e6dcbb17a1bb5be057cb"
server_key_version: "encryptionkey@0"
I20260806 11:47:20.132411 6296 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260806 11:47:20.137590 6316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:20.140364 6296 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260806 11:47:20.140580 6296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "78802a02133e4d9ab031d9a6a62244e0"
format_stamp: "Formatted at 2026-08-06 11:47:20 on dist-test-slave-7z32"
server_key: "962db7c32bbd8bfb29ad80c736218086"
server_key_iv: "4e29a88bea35e6dcbb17a1bb5be057cb"
server_key_version: "encryptionkey@0"
I20260806 11:47:20.140765 6296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:20.159916 6296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:20.164623 6296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:20.164889 6296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:20.165676 6296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:20.166710 6296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:20.166769 6296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:20.166816 6296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:20.166925 6296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260806 11:47:20.179236 6296 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:46039
I20260806 11:47:20.179395 6466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:46039 every 8 connection(s)
I20260806 11:47:20.180428 6296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:47:20.185828 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 6296
I20260806 11:47:20.186038 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:47:20.186571 27315 external_mini_cluster.cc:1428] Setting key bc079de90197a1d10387aaed1c0baaac
Aug 06 11:47:20 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016840, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:47:20.205201 5931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:20.183440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:47677 (local address 127.26.172.254:34543)
0806 11:47:20.183721 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:20.183728 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:20.185228 (+ 1500us) server_negotiation.cc:407] Connection header received
0806 11:47:20.188195 (+ 2967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:20.188201 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:20.188295 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:20.188491 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:20.191194 (+ 2703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.192035 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.194317 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.194653 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.194907 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:20.199387 (+ 4480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:20.199393 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:20.199395 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:20.199431 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:20.201358 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:20.202279 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:20.202283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:20.202285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:20.202415 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:20.203365 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:20.203369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:20.203372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:20.203678 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:20.203781 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:20.204898 (+ 1117us) server_negotiation.cc:299] Negotiation successful
0806 11:47:20.205063 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260806 11:47:20.206604 6469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:20.184077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:47677)
0806 11:47:20.184962 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:20.185038 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:20.187471 (+ 2433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:20.188924 (+ 1453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:20.188940 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:20.189695 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:20.190904 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:20.190945 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.192441 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.192446 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:20.194048 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:20.194068 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.195159 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.195164 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:20.195405 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:20.196321 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:20.196347 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:20.199087 (+ 2740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:20.201560 (+ 2473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:20.201571 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:20.201599 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:20.202117 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:20.202599 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:20.202608 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:20.202611 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:20.203117 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:20.203858 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:20.203871 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:20.204509 (+ 638us) client_negotiation.cc:769] Sending connection context
0806 11:47:20.204779 (+ 270us) client_negotiation.cc:240] Negotiation successful
0806 11:47:20.205277 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":267,"threads_started":1}
I20260806 11:47:20.208492 6467 heartbeater.cc:347] Connected to a master server at 127.26.172.254:34543
I20260806 11:47:20.208935 6467 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:20.209842 6467 heartbeater.cc:511] Master 127.26.172.254:34543 requested a full tablet report, sending...
I20260806 11:47:20.211527 5882 ts_manager.cc:194] Registered new tserver with Master: 78802a02133e4d9ab031d9a6a62244e0 (127.26.172.195:46039)
I20260806 11:47:20.212363 5882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:47677
I20260806 11:47:20.217972 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab.
Entry for principal oryx/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab.
WARNING: no policy specified for oryx/127.26.172.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab.
Entry for principal oryx/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab.
WARNING: no policy specified for oryx/127.26.172.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.172.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab.
Entry for principal oryx/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab.
I20260806 11:47:20.348886 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 5959
I20260806 11:47:20.369462 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 6125
I20260806 11:47:20.387494 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 6296
I20260806 11:47:20.401506 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 5839
I20260806 11:47:20.417795 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:34543
--webserver_interface=127.26.172.254
--webserver_port=37719
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:34543
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:20.567930 6476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:20.568372 6476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:20.568423 6476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:20.573582 6476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:20.573716 6476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:20.573738 6476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:20.573760 6476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:20.573778 6476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:20.580902 6476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:34543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:34543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=37719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:20.582695 6476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:20.584281 6476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 11:47:20.596576 6476 server_base.cc:1034] running on GCE node
W20260806 11:47:20.596447 6486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:20.596411 6483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:20.596468 6488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:20.597957 6476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:20.599824 6476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:20.601183 6476 hybrid_clock.cc:648] HybridClock initialized: now 1786016840601131 us; error 78 us; skew 500 ppm
Aug 06 11:47:20 dist-test-slave-7z32 krb5kdc[5818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016840, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:20.606077 6476 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:47:20.608067 6476 webserver.cc:460] Webserver started at http://127.26.172.254:37719/ using document root <none> and password file <none>
I20260806 11:47:20.608987 6476 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:20.609200 6476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:20.615594 6476 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:47:20.619588 6499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:20.621913 6476 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:47:20.622196 6476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "43ce0e17dc1c41149161f0b638642233"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "447b4e245cca2ac650750edafa5baf71"
server_key_iv: "9b98b9394774b7f02fdd17a9cd086571"
server_key_version: "encryptionkey@0"
I20260806 11:47:20.623241 6476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:20.648842 6476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:20.653764 6476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:20.654065 6476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:20.665077 6476 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:34543
I20260806 11:47:20.665155 6574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:34543 every 8 connection(s)
I20260806 11:47:20.666682 6476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:20.670899 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 6476
I20260806 11:47:20.671558 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:45043
--local_ip_for_outbound_sockets=127.26.172.193
--tserver_master_addrs=127.26.172.254:34543
--webserver_port=46127
--webserver_interface=127.26.172.193
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.172.193
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:47:20.673523 6576 sys_catalog.cc:263] Verifying existing consensus state
I20260806 11:47:20.675875 6576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: Bootstrap starting.
I20260806 11:47:20.696460 6576 log.cc:824] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:20.705116 6576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:47:20.705654 6576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: Bootstrap complete.
I20260806 11:47:20.710632 6576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } }
I20260806 11:47:20.711422 6576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ce0e17dc1c41149161f0b638642233, State: Initialized, Role: FOLLOWER
I20260806 11:47:20.712323 6576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } }
I20260806 11:47:20.712476 6576 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:20.712587 6576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:20.712730 6576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 1 FOLLOWER]: Advancing to term 2
I20260806 11:47:20.715222 6576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } }
I20260806 11:47:20.715670 6576 leader_election.cc:302] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43ce0e17dc1c41149161f0b638642233; no voters:
I20260806 11:47:20.716096 6576 leader_election.cc:288] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 11:47:20.716204 6581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 11:47:20.716451 6581 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [term 2 LEADER]: Becoming Leader. State: Replica: 43ce0e17dc1c41149161f0b638642233, State: Running, Role: LEADER
I20260806 11:47:20.716797 6581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } }
I20260806 11:47:20.717620 6576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:20.718611 6582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "43ce0e17dc1c41149161f0b638642233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } } }
I20260806 11:47:20.718889 6582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:20.719698 6583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43ce0e17dc1c41149161f0b638642233. Latest consensus state: current_term: 2 leader_uuid: "43ce0e17dc1c41149161f0b638642233" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ce0e17dc1c41149161f0b638642233" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 34543 } } }
I20260806 11:47:20.719936 6583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:20.723924 6602 catalog_manager.cc:1259] Loaded cluster ID: 59465ee979e74b5abab267ecf80a1523
I20260806 11:47:20.724032 6602 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: loading cluster ID for follower catalog manager: success
I20260806 11:47:20.726791 6602 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: acquiring CA information for follower catalog manager: success
I20260806 11:47:20.728708 6602 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 11:47:20.728960 6594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:20.730329 6594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:20.730890 6594 catalog_manager.cc:1259] Loaded cluster ID: 59465ee979e74b5abab267ecf80a1523
I20260806 11:47:20.730962 6594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:20.731902 6594 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:20.732450 6594 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 43ce0e17dc1c41149161f0b638642233: Loaded TSK: 0
I20260806 11:47:20.733508 6594 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 11:47:20.834892 6578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:20.835355 6578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:20.835448 6578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:20.840281 6578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:20.840442 6578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:20.840569 6578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:47:20.847949 6578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.193.keytab
--principal=oryx/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:45043
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=46127
--tserver_master_addrs=127.26.172.254:34543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:20.849722 6578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:20.851428 6578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:20.866447 6609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:20.866534 6612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:20.866576 6610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:20.867055 6578 server_base.cc:1034] running on GCE node
I20260806 11:47:20.867884 6578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:20.868943 6578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:20.870400 6578 hybrid_clock.cc:648] HybridClock initialized: now 1786016840870339 us; error 143 us; skew 500 ppm
Aug 06 11:47:20 dist-test-slave-7z32 krb5kdc[5818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016840, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:20.875572 6578 init.cc:377] Logged in from keytab as oryx/127.26.172.193@KRBTEST.COM (short username oryx)
I20260806 11:47:20.877621 6578 webserver.cc:460] Webserver started at http://127.26.172.193:46127/ using document root <none> and password file <none>
I20260806 11:47:20.878543 6578 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:20.878692 6578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:20.884815 6578 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:47:20.888511 6624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:20.891287 6578 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:47:20.891587 6578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "ee82fcf647a94956a72df7ad8d2ecdd5"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "f632c35a2a374e9ac75a224698e7078b"
server_key_iv: "788e4def4e5dfddd670932553e4e12fa"
server_key_version: "encryptionkey@0"
I20260806 11:47:20.892488 6578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:20.921721 6578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:20.927280 6578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:20.927592 6578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:20.928758 6578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:20.930171 6578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:20.930303 6578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:20.930409 6578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:20.930460 6578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:20.945153 6794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:45043 every 8 connection(s)
I20260806 11:47:20.945147 6578 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:45043
I20260806 11:47:20.946880 6578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:47:20.954425 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 6578
I20260806 11:47:20.955086 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:41343
--local_ip_for_outbound_sockets=127.26.172.194
--tserver_master_addrs=127.26.172.254:34543
--webserver_port=40973
--webserver_interface=127.26.172.194
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.172.194
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:47:20 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:20 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
W20260806 11:47:20.970549 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:20.949967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:54479 (local address 127.26.172.254:34543)
0806 11:47:20.950713 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:20.950736 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:20.951094 (+ 358us) server_negotiation.cc:407] Connection header received
0806 11:47:20.953734 (+ 2640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:20.953751 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:20.954275 (+ 524us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:20.954771 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:20.956971 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.958944 (+ 1973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.961676 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.962590 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.962799 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:20.969447 (+ 6648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:54479: BlockingRecv error: recv got EOF from 127.26.172.193:54479 (error 108)
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":180,"threads_started":1}
I20260806 11:47:20.970559 6799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:20.949995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:54479)
0806 11:47:20.950687 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:20.950742 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:20.953016 (+ 2274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:20.955149 (+ 2133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:20.955185 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:20.955887 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:20.956616 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:20.956640 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.959298 (+ 2658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.959305 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:20.961349 (+ 2044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:20.961382 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.962913 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.962922 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:20.963206 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:20.964283 (+ 1077us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:20.964320 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:20.968890 (+ 4570us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":189,"threads_started":1}
W20260806 11:47:20.971777 6795 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:34543 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.172.254:34543: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Aug 06 11:47:20 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:20 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:20.980734 6799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:20.972595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:57809)
0806 11:47:20.972957 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:20.972980 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:20.973152 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:20.973597 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:20.973600 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:20.973875 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:20.974152 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:20.974165 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.975551 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.975555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:20.976373 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:20.976387 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.977203 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.977207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:20.977309 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:20.978182 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:20.978197 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:20.980570 (+ 2373us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237}
W20260806 11:47:20.981289 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:20.972948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:57809 (local address 127.26.172.254:34543)
0806 11:47:20.973219 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:20.973225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:20.973250 (+ 25us) server_negotiation.cc:407] Connection header received
0806 11:47:20.973320 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:20.973324 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:20.973397 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:20.973525 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:20.974343 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.975378 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.976551 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.976993 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.977132 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:20.981107 (+ 3975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:57809: BlockingRecv error: recv got EOF from 127.26.172.193:57809 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 06 11:47:20 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:20 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:20.989341 6799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:20.981619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:36989)
0806 11:47:20.981830 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:20.981852 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:20.981986 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:20.982377 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:20.982380 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:20.982645 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:20.982866 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:20.982878 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.983940 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.983945 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:20.984978 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:20.984992 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.985723 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.985729 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:20.985869 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:20.986572 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:20.986634 (+ 62us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:20.989112 (+ 2478us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":76}
W20260806 11:47:20.989488 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:20.981807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:36989 (local address 127.26.172.254:34543)
0806 11:47:20.981979 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:20.981984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:20.982003 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:47:20.982151 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:20.982154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:20.982214 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:20.982303 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:20.983062 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.983781 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.985182 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:20.985462 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:20.985633 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:20.989338 (+ 3705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:36989: BlockingRecv error: recv got EOF from 127.26.172.193:36989 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260806 11:47:20.989758 6795 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 11:47:21.109476 6804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:21.109900 6804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:21.109989 6804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:21.114423 6804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:21.114569 6804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:21.114684 6804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:47:21.122619 6804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.194.keytab
--principal=oryx/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:41343
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=40973
--tserver_master_addrs=127.26.172.254:34543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:21.124207 6804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:21.125701 6804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:21.139350 6814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:21.139540 6804 server_base.cc:1034] running on GCE node
W20260806 11:47:21.139362 6810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:21.139451 6812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:21.140512 6804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:21.141438 6804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:21.144843 6804 hybrid_clock.cc:648] HybridClock initialized: now 1786016841144804 us; error 95 us; skew 500 ppm
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016841, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:21.149513 6804 init.cc:377] Logged in from keytab as oryx/127.26.172.194@KRBTEST.COM (short username oryx)
I20260806 11:47:21.150767 6804 webserver.cc:460] Webserver started at http://127.26.172.194:40973/ using document root <none> and password file <none>
I20260806 11:47:21.151546 6804 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:21.151695 6804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:21.157889 6804 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260806 11:47:21.161463 6828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:21.163506 6804 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:21.163720 6804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "17c1f514c8f545f1989db73d1d21a280"
format_stamp: "Formatted at 2026-08-06 11:47:19 on dist-test-slave-7z32"
server_key: "07e0139288e9d8931466e786b04a8667"
server_key_iv: "331858970c679a0de2c2953356aa6424"
server_key_version: "encryptionkey@0"
I20260806 11:47:21.164433 6804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:21.192813 6804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:21.197041 6804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:21.197283 6804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:21.198148 6804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:21.199374 6804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:21.199456 6804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:21.199537 6804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:21.199581 6804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:21.215297 6804 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:41343
I20260806 11:47:21.215354 6986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:41343 every 8 connection(s)
I20260806 11:47:21.216665 6804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:47:21.219956 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 6804
I20260806 11:47:21.220589 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:46039
--local_ip_for_outbound_sockets=127.26.172.195
--tserver_master_addrs=127.26.172.254:34543
--webserver_port=37641
--webserver_interface=127.26.172.195
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.172.195
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
W20260806 11:47:21.233670 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:21.222399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:35877 (local address 127.26.172.254:34543)
0806 11:47:21.223078 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:21.223082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:21.223114 (+ 32us) server_negotiation.cc:407] Connection header received
0806 11:47:21.224407 (+ 1293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:21.224411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:21.224527 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:21.224662 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:21.226214 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.226789 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.228555 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.228892 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.229015 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.233515 (+ 4500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:35877: BlockingRecv error: recv got EOF from 127.26.172.194:35877 (error 108)
Metrics: {"server-negotiator.queue_time_us":530}
I20260806 11:47:21.234452 6991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:21.220790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:35877)
0806 11:47:21.221795 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:21.221962 (+ 167us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:21.223954 (+ 1992us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:21.224902 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:21.224912 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:21.225389 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:21.226006 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.226033 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.227015 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.227018 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.228370 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.228387 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.229097 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.229101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.229308 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.230047 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:21.230066 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:21.233326 (+ 3260us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":202,"threads_started":1}
W20260806 11:47:21.235275 6989 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:34543 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.172.254:34543: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:21.244683 6991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:21.236162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:36907)
0806 11:47:21.236391 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:21.236411 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:21.236619 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:21.237262 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:21.237266 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:21.237562 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:21.237744 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.237754 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.239665 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.239669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.240332 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.240347 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.241165 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.241169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.241266 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.241992 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:21.242022 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:21.244410 (+ 2388us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":83}
W20260806 11:47:21.244786 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:21.236232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:36907 (local address 127.26.172.254:34543)
0806 11:47:21.236388 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:21.236393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:21.236512 (+ 119us) server_negotiation.cc:407] Connection header received
0806 11:47:21.236793 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:21.236799 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:21.236861 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:21.236932 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:21.237984 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.239425 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.240510 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.240949 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.241107 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.244655 (+ 3548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:36907: BlockingRecv error: recv got EOF from 127.26.172.194:36907 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:21.251576 6991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:21.245896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:40385)
0806 11:47:21.246068 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:21.246088 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:21.246199 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:21.246528 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:21.246531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:21.246727 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:21.246890 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.246905 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.247689 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.247692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.248239 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.248248 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.248727 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.248731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.248816 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.249371 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:21.249385 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:21.251379 (+ 1994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 11:47:21.251642 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:21.246005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:40385 (local address 127.26.172.254:34543)
0806 11:47:21.246142 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:21.246146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:21.246161 (+ 15us) server_negotiation.cc:407] Connection header received
0806 11:47:21.246343 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:21.246346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:21.246399 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:21.246501 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:21.247022 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.247566 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.248370 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.248597 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.248714 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.251527 (+ 2813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:40385: BlockingRecv error: recv got EOF from 127.26.172.194:40385 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260806 11:47:21.252226 6989 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 11:47:21.388830 6993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:21.389288 6993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:21.389374 6993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:21.394251 6993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:21.394395 6993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:21.394508 6993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:47:21.402002 6993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/krb5kdc/oryx_127.26.172.195.keytab
--principal=oryx/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:46039
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=37641
--tserver_master_addrs=127.26.172.254:34543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:21.404067 6993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:21.405683 6993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:21.420715 7000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:21.420840 6993 server_base.cc:1034] running on GCE node
W20260806 11:47:21.420797 6999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:21.421103 7003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:21.421929 6993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:21.422887 6993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:21.424103 6993 hybrid_clock.cc:648] HybridClock initialized: now 1786016841424066 us; error 59 us; skew 500 ppm
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016841, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:21.427605 6993 init.cc:377] Logged in from keytab as oryx/127.26.172.195@KRBTEST.COM (short username oryx)
I20260806 11:47:21.428977 6993 webserver.cc:460] Webserver started at http://127.26.172.195:37641/ using document root <none> and password file <none>
I20260806 11:47:21.429771 6993 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:21.429880 6993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:21.435148 6993 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:47:21.438205 7010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:21.440239 6993 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:47:21.440423 6993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "78802a02133e4d9ab031d9a6a62244e0"
format_stamp: "Formatted at 2026-08-06 11:47:20 on dist-test-slave-7z32"
server_key: "962db7c32bbd8bfb29ad80c736218086"
server_key_iv: "4e29a88bea35e6dcbb17a1bb5be057cb"
server_key_version: "encryptionkey@0"
I20260806 11:47:21.441092 6993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:21.456733 6993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:21.460587 6993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:21.460775 6993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:21.461594 6993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:21.462576 6993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:21.462656 6993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:21.462762 6993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:21.462817 6993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:21.474493 6993 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:46039
I20260806 11:47:21.474555 7150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:46039 every 8 connection(s)
I20260806 11:47:21.475863 6993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:47:21.483736 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 6993
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
W20260806 11:47:21.491534 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:21.478855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:49565 (local address 127.26.172.254:34543)
0806 11:47:21.479124 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:21.479129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:21.480300 (+ 1171us) server_negotiation.cc:407] Connection header received
0806 11:47:21.482173 (+ 1873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:21.482177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:21.482240 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:21.482355 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:21.484305 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.485071 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.486632 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.486941 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.487065 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.491383 (+ 4318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:49565: BlockingRecv error: recv got EOF from 127.26.172.195:49565 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
I20260806 11:47:21.492694 7154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:21.479279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:49565)
0806 11:47:21.480029 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:21.480112 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:21.481871 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:21.482648 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:21.482658 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:21.483286 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:21.484046 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.484072 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.485279 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.485291 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.486485 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.486501 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.487121 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.487125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.487314 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.487997 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:21.488015 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:21.491234 (+ 3219us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":218,"threads_started":1}
W20260806 11:47:21.493477 7151 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:34543 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.172.254:34543: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
I20260806 11:47:21.496330 7156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:21.485239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49096 (local address 127.26.172.254:34543)
0806 11:47:21.485641 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:21.485645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:21.485661 (+ 16us) server_negotiation.cc:407] Connection header received
0806 11:47:21.485700 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:21.485703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:21.485753 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:21.485863 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:21.486812 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.487484 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.488423 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.488722 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.488857 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.490805 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:21.490812 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:21.490885 (+ 73us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:21.490928 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:21.493179 (+ 2251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:21.493910 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:21.493917 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:21.493924 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:21.494099 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:21.494581 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:21.494586 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:21.494588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:21.495229 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:21.495490 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:21.495834 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 11:47:21.496169 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":159,"threads_started":1}
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:21.500711 7154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:21.494079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:43689)
0806 11:47:21.494290 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:21.494311 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:21.494412 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:21.494682 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:21.494685 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:21.494950 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:21.495092 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.495098 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.495897 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.495901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.496761 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.496789 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.497271 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.497274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.497374 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.498064 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:21.498078 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:21.500593 (+ 2515us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":79}
W20260806 11:47:21.500957 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:21.494232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:43689 (local address 127.26.172.254:34543)
0806 11:47:21.494380 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:21.494384 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:21.494397 (+ 13us) server_negotiation.cc:407] Connection header received
0806 11:47:21.494497 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:21.494501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:21.494541 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:21.494639 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:21.495234 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.495780 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.496919 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.497146 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.497256 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.500790 (+ 3534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:43689: BlockingRecv error: recv got EOF from 127.26.172.195:43689 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:21.507864 7154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:21.501694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:53951)
0806 11:47:21.501946 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:21.501960 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:21.502031 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:21.502396 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:21.502400 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:21.502606 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:21.502715 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.502721 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.503754 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.503758 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.504322 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.504330 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.504820 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.504824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.504912 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.505518 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:21.505540 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:21.507715 (+ 2175us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176}
W20260806 11:47:21.508208 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:21.501783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:53951 (local address 127.26.172.254:34543)
0806 11:47:21.501975 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:21.501979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:21.501998 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:47:21.502147 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:21.502150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:21.502247 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:21.502366 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:21.502877 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.503635 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.504451 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.504694 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.504809 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.508028 (+ 3219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:53951: BlockingRecv error: recv got EOF from 127.26.172.195:53951 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260806 11:47:21.508208 7151 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:21 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:22.000692 7158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:21.990832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:55807)
0806 11:47:21.991262 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:21.991278 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:21.991463 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:21.991788 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:21.991791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:21.992061 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:21.992214 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.992221 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.993771 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.993779 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.994725 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:21.994739 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.995695 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.995699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:21.995824 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:21.996610 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:21.996628 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:22.000421 (+ 3793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":144,"threads_started":1}
W20260806 11:47:22.000800 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:21.991053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:55807 (local address 127.26.172.254:34543)
0806 11:47:21.991250 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:21.991255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:21.991391 (+ 136us) server_negotiation.cc:407] Connection header received
0806 11:47:21.991592 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:21.991596 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:21.991666 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:21.991753 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:21.992352 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.993472 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.994910 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:21.995366 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:21.995743 (+ 377us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:22.000649 (+ 4906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:55807: BlockingRecv error: recv got EOF from 127.26.172.193:55807 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 11:47:22 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:22 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:22.260164 7159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:22.253394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:40729)
0806 11:47:22.253835 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:22.253858 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:22.254044 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:22.254427 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:22.254431 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:22.254730 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:22.254889 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:22.254897 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:22.255749 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:22.255754 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:22.256370 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:22.256380 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:22.256898 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:22.256901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:22.256982 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:22.257600 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:22.257613 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:22.259958 (+ 2345us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":150,"threads_started":1}
W20260806 11:47:22.260252 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:22.253453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:40729 (local address 127.26.172.254:34543)
0806 11:47:22.253646 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:22.253651 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:22.254004 (+ 353us) server_negotiation.cc:407] Connection header received
0806 11:47:22.254166 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:22.254169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:22.254242 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:22.254365 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:22.255073 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:22.255622 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:22.256516 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:22.256754 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:22.256884 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:22.260122 (+ 3238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:40729: BlockingRecv error: recv got EOF from 127.26.172.194:40729 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 06 11:47:22 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:22 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:22.516866 7160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:22.509205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:44519)
0806 11:47:22.509613 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:22.509638 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:22.509791 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:22.510346 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:22.510350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:22.510658 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:22.510914 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:22.510922 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:22.511993 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:22.511998 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:22.512810 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:22.512823 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:22.513373 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:22.513377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:22.513466 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:22.514189 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:22.514203 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:22.516675 (+ 2472us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":154,"threads_started":1}
W20260806 11:47:22.517082 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:22.509341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:44519 (local address 127.26.172.254:34543)
0806 11:47:22.509514 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:22.509518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:22.509733 (+ 215us) server_negotiation.cc:407] Connection header received
0806 11:47:22.509996 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:22.510001 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:22.510087 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:22.510238 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:22.511022 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:22.511841 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:22.512962 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:22.513197 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:22.513369 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:22.516911 (+ 3542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:44519: BlockingRecv error: recv got EOF from 127.26.172.195:44519 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 06 11:47:23 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:23 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:23.009686 7161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:23.001937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:45581)
0806 11:47:23.002263 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:23.002306 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:23.002449 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:23.002781 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:23.002784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:23.003084 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:23.003195 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:23.003202 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.004187 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.004191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:23.004791 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:23.004800 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.005297 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.005301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:23.005385 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:23.006088 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:23.006101 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:23.009420 (+ 3319us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":119,"threads_started":1}
W20260806 11:47:23.009992 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:23.002216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:45581 (local address 127.26.172.254:34543)
0806 11:47:23.002438 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:23.002444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:23.002463 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:47:23.002569 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:23.002576 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:23.002656 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:23.002810 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:23.003416 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.004050 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.004940 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.005157 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.005273 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:23.009791 (+ 4518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:45581: BlockingRecv error: recv got EOF from 127.26.172.193:45581 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 06 11:47:23 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:23 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:23.269003 7162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:23.261615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:56453)
0806 11:47:23.262028 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:23.262057 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:23.262207 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:23.262619 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:23.262621 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:23.262871 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:23.263014 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:23.263021 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.264109 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.264112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:23.264701 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:23.264711 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.265407 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.265412 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:23.265533 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:23.266265 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:23.266283 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:23.268860 (+ 2577us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":160,"threads_started":1}
W20260806 11:47:23.269500 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:23.261828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:56453 (local address 127.26.172.254:34543)
0806 11:47:23.262016 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:23.262021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:23.262231 (+ 210us) server_negotiation.cc:407] Connection header received
0806 11:47:23.262325 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:23.262328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:23.262394 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:23.262526 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:23.263234 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.263939 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.264877 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.265234 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.265386 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:23.269334 (+ 3948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:56453: BlockingRecv error: recv got EOF from 127.26.172.194:56453 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 06 11:47:23 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:23 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:23.526116 7163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:23.518285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:33999)
0806 11:47:23.518714 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:23.518742 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:23.518957 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:23.519410 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:23.519441 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:23.519722 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:23.519922 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:23.519931 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.520930 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.520936 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:23.521586 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:23.521595 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.522137 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.522142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:23.522236 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:23.523003 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:23.523024 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:23.525879 (+ 2855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":215,"threads_started":1}
W20260806 11:47:23.526238 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:23.518662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:33999 (local address 127.26.172.254:34543)
0806 11:47:23.518989 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:23.518995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:23.519022 (+ 27us) server_negotiation.cc:407] Connection header received
0806 11:47:23.519145 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:23.519149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:23.519212 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:23.519341 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:23.520163 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.520779 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.521737 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:23.521984 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:23.522114 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:23.526084 (+ 3970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:33999: BlockingRecv error: recv got EOF from 127.26.172.195:33999 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 06 11:47:24 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:24 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:24.019652 7165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:24.011590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:44023)
0806 11:47:24.011982 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:24.012000 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:24.012147 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:24.012636 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:24.012639 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:24.012919 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:24.013062 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:24.013068 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.014122 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.014126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:24.014980 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:24.014994 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.015580 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.015583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:24.015660 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:24.016461 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:24.016476 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:24.019373 (+ 2897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":125,"threads_started":1}
W20260806 11:47:24.019778 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:24.011783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:44023 (local address 127.26.172.254:34543)
0806 11:47:24.012239 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:24.012244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:24.012267 (+ 23us) server_negotiation.cc:407] Connection header received
0806 11:47:24.012332 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:24.012336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:24.012396 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:24.012519 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:24.013296 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.013927 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.015145 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.015422 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.015536 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:24.019644 (+ 4108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:44023: BlockingRecv error: recv got EOF from 127.26.172.193:44023 (error 108)
Metrics: {"server-negotiator.queue_time_us":322}
Aug 06 11:47:24 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:24 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:24.283828 7166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:24.270559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:47373)
0806 11:47:24.271048 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:24.271067 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:24.271246 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:24.271714 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:24.271717 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:24.272035 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:24.272189 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:24.272196 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.273093 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.273098 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:24.273715 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:24.273724 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.274251 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.274255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:24.274341 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:24.280858 (+ 6517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:24.280883 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:24.283527 (+ 2644us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":158,"threads_started":1}
W20260806 11:47:24.283933 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:24.270673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:47373 (local address 127.26.172.254:34543)
0806 11:47:24.270940 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:24.270947 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:24.271203 (+ 256us) server_negotiation.cc:407] Connection header received
0806 11:47:24.271367 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:24.271371 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:24.271444 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:24.271572 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:24.272350 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.272952 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.273864 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.274105 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.274235 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:24.283774 (+ 9539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:47373: BlockingRecv error: recv got EOF from 127.26.172.194:47373 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 06 11:47:24 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:24 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:24.535213 7168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:24.527425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:48193)
0806 11:47:24.527934 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:24.527995 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:24.528206 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:24.528607 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:24.528612 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:24.528870 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:24.528977 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:24.528983 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.529868 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.529874 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:24.530508 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:24.530517 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.531141 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.531145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:24.531242 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:24.531948 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:24.531962 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:24.534807 (+ 2845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":132,"threads_started":1}
W20260806 11:47:24.535240 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:24.527646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:48193 (local address 127.26.172.254:34543)
0806 11:47:24.527882 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:24.527888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:24.528124 (+ 236us) server_negotiation.cc:407] Connection header received
0806 11:47:24.528328 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:24.528332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:24.528391 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:24.528475 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:24.529140 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.529735 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.530650 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:24.530989 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:24.531122 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:24.535096 (+ 3974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:48193: BlockingRecv error: recv got EOF from 127.26.172.195:48193 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 06 11:47:25 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:25 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:25.029501 7171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:25.021076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:33115)
0806 11:47:25.021773 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:25.021791 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:25.021973 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:25.022498 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:25.022501 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:25.023134 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:25.023309 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:25.023317 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.024367 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.024370 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:25.025084 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:25.025096 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.025740 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.025744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:25.025833 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:25.026632 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:25.026650 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:25.029328 (+ 2678us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":137,"threads_started":1}
W20260806 11:47:25.029901 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:25.021270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:33115 (local address 127.26.172.254:34543)
0806 11:47:25.021446 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:25.021452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:25.021911 (+ 459us) server_negotiation.cc:407] Connection header received
0806 11:47:25.022228 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:25.022232 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:25.022304 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:25.022440 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:25.023567 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.024155 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.025295 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.025554 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.025667 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:25.029686 (+ 4019us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:33115: BlockingRecv error: recv got EOF from 127.26.172.193:33115 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 06 11:47:25 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:25 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:25.293781 7172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:25.285309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:38409)
0806 11:47:25.285750 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:25.285770 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:25.285954 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:25.286303 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:25.286306 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:25.286570 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:25.286688 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:25.286695 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.287611 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.287616 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:25.288267 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:25.288276 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.288818 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.288822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:25.288922 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:25.289881 (+ 959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:25.289902 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:25.293477 (+ 3575us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":140,"threads_started":1}
W20260806 11:47:25.293942 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:25.285417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:38409 (local address 127.26.172.254:34543)
0806 11:47:25.285694 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:25.285701 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:25.285882 (+ 181us) server_negotiation.cc:407] Connection header received
0806 11:47:25.286097 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:25.286102 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:25.286162 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:25.286266 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:25.286872 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.287463 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.288414 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.288671 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.288800 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:25.293756 (+ 4956us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:38409: BlockingRecv error: recv got EOF from 127.26.172.194:38409 (error 108)
Metrics: {"server-negotiator.queue_time_us":143}
Aug 06 11:47:25 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:25 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:25.543362 7173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:25.536649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:48145)
0806 11:47:25.537068 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:25.537094 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:25.537238 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:25.537545 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:25.537548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:25.537800 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:25.537910 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:25.537916 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.538908 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.538912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:25.539536 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:25.539545 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.540096 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.540100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:25.540197 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:25.540932 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:25.540952 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:25.543169 (+ 2217us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":139,"threads_started":1}
W20260806 11:47:25.543495 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:25.536996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:48145 (local address 127.26.172.254:34543)
0806 11:47:25.537213 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:25.537219 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:25.537245 (+ 26us) server_negotiation.cc:407] Connection header received
0806 11:47:25.537346 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:25.537350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:25.537415 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:25.537519 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:25.538048 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.538722 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.539688 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:25.539942 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:25.540081 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:25.543363 (+ 3282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:48145: BlockingRecv error: recv got EOF from 127.26.172.195:48145 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 06 11:47:26 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:26 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:26.038378 7174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:26.030934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:49783)
0806 11:47:26.031319 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:26.031336 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:26.031540 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:26.031888 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:26.031890 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:26.032107 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:26.032227 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:26.032232 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.033171 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.033174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:26.033853 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:26.033863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.034444 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.034446 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:26.034514 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:26.035287 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:26.035300 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:26.038072 (+ 2772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":115,"threads_started":1}
W20260806 11:47:26.038535 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:26.031070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:49783 (local address 127.26.172.254:34543)
0806 11:47:26.031309 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:26.031313 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:26.031563 (+ 250us) server_negotiation.cc:407] Connection header received
0806 11:47:26.031644 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:26.031648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:26.031719 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:26.031840 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:26.032377 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.033015 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.034010 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.034295 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.034407 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:26.038351 (+ 3944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:49783: BlockingRecv error: recv got EOF from 127.26.172.193:49783 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Aug 06 11:47:26 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:26 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:26.304711 7175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:26.296362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:59519)
0806 11:47:26.296868 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:26.296889 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:26.297054 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:26.297538 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:26.297541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:26.297778 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:26.298028 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:26.298037 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.299147 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.299152 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:26.300234 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:26.300250 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.300856 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.300860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:26.300947 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:26.301628 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:26.301641 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:26.304499 (+ 2858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":155,"threads_started":1}
W20260806 11:47:26.304757 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:26.296651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:59519 (local address 127.26.172.254:34543)
0806 11:47:26.296870 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:26.296875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:26.297144 (+ 269us) server_negotiation.cc:407] Connection header received
0806 11:47:26.297214 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:26.297217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:26.297278 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:26.297390 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:26.298225 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.298967 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.300418 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.300679 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.300827 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:26.304623 (+ 3796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:59519: BlockingRecv error: recv got EOF from 127.26.172.194:59519 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 06 11:47:26 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:26 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:26.552407 7177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:26.544571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:54233)
0806 11:47:26.545091 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:26.545109 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:26.545322 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:26.545700 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:26.545702 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:26.545957 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:26.546164 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:26.546171 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.547164 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.547168 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:26.547839 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:26.547850 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.548454 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.548458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:26.548543 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:26.549355 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:26.549369 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:26.552220 (+ 2851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":130,"threads_started":1}
W20260806 11:47:26.552939 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:26.544930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:54233 (local address 127.26.172.254:34543)
0806 11:47:26.545105 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:26.545110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:26.545251 (+ 141us) server_negotiation.cc:407] Connection header received
0806 11:47:26.545460 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:26.545463 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:26.545523 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:26.545607 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:26.546306 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.546995 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.548033 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:26.548274 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:26.548379 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:26.552728 (+ 4349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:54233: BlockingRecv error: recv got EOF from 127.26.172.195:54233 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 11:47:27 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:27 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:27.048516 7178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:27.039942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:44561)
0806 11:47:27.040403 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:27.040422 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:27.040663 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:27.041186 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:27.041189 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:27.041477 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:27.041655 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:27.041663 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.042782 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.042787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:27.043711 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:27.043725 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.044333 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.044339 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:27.044426 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:27.045229 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:27.045244 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:27.048281 (+ 3037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":170,"threads_started":1}
W20260806 11:47:27.048903 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:27.040123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:44561 (local address 127.26.172.254:34543)
0806 11:47:27.040346 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:27.040350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:27.040583 (+ 233us) server_negotiation.cc:407] Connection header received
0806 11:47:27.040804 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:27.040807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:27.040870 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:27.041037 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:27.041861 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.042585 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.043846 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.044161 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.044267 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:27.048708 (+ 4441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:44561: BlockingRecv error: recv got EOF from 127.26.172.193:44561 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 06 11:47:27 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:27 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:27.314225 7179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:27.306192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:46931)
0806 11:47:27.306568 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:27.306591 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:27.306802 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:27.307227 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:27.307230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:27.307508 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:27.307639 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:27.307646 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.308657 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.308661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:27.309304 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:27.309315 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.310013 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.310016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:27.310129 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:27.310799 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:27.310813 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:27.314002 (+ 3189us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":130,"threads_started":1}
W20260806 11:47:27.314342 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:27.306320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:46931 (local address 127.26.172.254:34543)
0806 11:47:27.306656 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:27.306660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:27.306752 (+ 92us) server_negotiation.cc:407] Connection header received
0806 11:47:27.307020 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:27.307024 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:27.307088 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:27.307198 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:27.307774 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.308519 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.309461 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.309831 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.309977 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:27.314213 (+ 4236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:46931: BlockingRecv error: recv got EOF from 127.26.172.194:46931 (error 108)
Metrics: {"server-negotiator.queue_time_us":216}
Aug 06 11:47:27 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:27 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:27.562332 7180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:27.553944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:36393)
0806 11:47:27.554434 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:27.554454 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:27.554627 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:27.555122 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:27.555125 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:27.555355 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:27.555674 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:27.555691 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.556689 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.556692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:27.557412 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:27.557424 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.558019 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.558023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:27.558129 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:27.558994 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:27.559009 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:27.562122 (+ 3113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":116,"threads_started":1}
W20260806 11:47:27.562402 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:27.554270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:36393 (local address 127.26.172.254:34543)
0806 11:47:27.554729 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:27.554734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:27.554753 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:47:27.554810 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:27.554813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:27.554907 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:27.555021 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:27.555883 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.556487 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.557589 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:27.557838 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:27.557966 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:27.562278 (+ 4312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:36393: BlockingRecv error: recv got EOF from 127.26.172.195:36393 (error 108)
Metrics: {"server-negotiator.queue_time_us":333}
Aug 06 11:47:28 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:28 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:28.058116 7182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:28.049975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:46557)
0806 11:47:28.050447 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:28.050465 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:28.050672 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:28.051311 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:28.051315 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:28.051683 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:28.051882 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:28.051891 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.053016 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.053019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:28.053759 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:28.053771 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.054380 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.054384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:28.054464 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:28.055285 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:28.055300 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:28.057940 (+ 2640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":132,"threads_started":1}
W20260806 11:47:28.058355 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:28.050228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:46557 (local address 127.26.172.254:34543)
0806 11:47:28.050414 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:28.050419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:28.050587 (+ 168us) server_negotiation.cc:407] Connection header received
0806 11:47:28.050974 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:28.050978 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:28.051048 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:28.051178 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:28.052096 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.052831 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.053941 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.054219 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.054343 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:28.058162 (+ 3819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:46557: BlockingRecv error: recv got EOF from 127.26.172.193:46557 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 06 11:47:28 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:28 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:28.323253 7183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:28.315733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:58495)
0806 11:47:28.316225 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:28.316241 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:28.316429 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:28.316847 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:28.316861 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:28.317146 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:28.317288 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:28.317296 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.318330 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.318333 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:28.319127 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:28.319141 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.319840 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.319843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:28.319917 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:28.320709 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:28.320722 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:28.323091 (+ 2369us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":143,"threads_started":1}
W20260806 11:47:28.323752 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:28.315879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:58495 (local address 127.26.172.254:34543)
0806 11:47:28.316098 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:28.316103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:28.316340 (+ 237us) server_negotiation.cc:407] Connection header received
0806 11:47:28.316557 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:28.316568 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:28.316651 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:28.316736 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:28.317505 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.318164 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.319328 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.319610 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.319806 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:28.323538 (+ 3732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:58495: BlockingRecv error: recv got EOF from 127.26.172.194:58495 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 06 11:47:28 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:28 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:28.571534 7185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:28.563818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:39131)
0806 11:47:28.564386 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:28.564408 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:28.564578 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:28.564995 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:28.564999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:28.565305 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:28.565495 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:28.565506 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.566558 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.566563 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:28.567269 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:28.567281 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.567887 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.567890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:28.567992 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:28.568782 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:28.568805 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:28.571388 (+ 2583us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":122,"threads_started":1}
W20260806 11:47:28.572038 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:28.564066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:39131 (local address 127.26.172.254:34543)
0806 11:47:28.564301 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:28.564308 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:28.564544 (+ 236us) server_negotiation.cc:407] Connection header received
0806 11:47:28.564715 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:28.564719 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:28.564790 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:28.564895 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:28.565682 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.566400 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.567463 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:28.567718 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:28.567836 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:28.571859 (+ 4023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:39131: BlockingRecv error: recv got EOF from 127.26.172.195:39131 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 11:47:29 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:29 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:29.067770 7186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:29.059597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:48595)
0806 11:47:29.060043 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:29.060062 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:29.060249 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:29.060740 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:29.060747 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:29.061091 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:29.061262 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:29.061270 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.062764 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.062767 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:29.063562 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:29.063575 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.064242 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.064246 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:29.064403 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:29.065172 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:29.065186 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:29.067597 (+ 2411us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":175,"threads_started":1}
W20260806 11:47:29.068271 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:29.060030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:48595 (local address 127.26.172.254:34543)
0806 11:47:29.060283 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:29.060292 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:29.060315 (+ 23us) server_negotiation.cc:407] Connection header received
0806 11:47:29.060385 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:29.060392 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:29.060485 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:29.060593 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:29.061530 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.062608 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.063752 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.064034 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.064178 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:29.068025 (+ 3847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:48595: BlockingRecv error: recv got EOF from 127.26.172.193:48595 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
Aug 06 11:47:29 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:29 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:29.340627 7188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:29.324480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:54807)
0806 11:47:29.324879 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:29.324904 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:29.325022 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:29.325995 (+ 973us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:29.325999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:29.326279 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:29.326420 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:29.326427 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.327943 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.327951 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:29.328679 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:29.328694 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.329625 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.329637 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:29.329773 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:29.336781 (+ 7008us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:29.336802 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:29.340427 (+ 3625us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":163,"threads_started":1}
W20260806 11:47:29.341089 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:29.324740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:54807 (local address 127.26.172.254:34543)
0806 11:47:29.324964 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:29.324969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:29.325000 (+ 31us) server_negotiation.cc:407] Connection header received
0806 11:47:29.325488 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:29.325494 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:29.325562 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:29.325810 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:29.326609 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.327720 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.328849 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.329097 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.329269 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:29.340776 (+ 11507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:54807: BlockingRecv error: recv got EOF from 127.26.172.194:54807 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 06 11:47:29 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:29 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:29.581091 7189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:29.573045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:60423)
0806 11:47:29.573388 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:29.573408 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:29.573546 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:29.574218 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:29.574221 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:29.574449 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:29.574571 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:29.574577 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.575623 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.575626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:29.576454 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:29.576470 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.577324 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.577328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:29.577417 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:29.578068 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:29.578080 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:29.580902 (+ 2822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":135,"threads_started":1}
W20260806 11:47:29.581354 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:29.573248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:60423 (local address 127.26.172.254:34543)
0806 11:47:29.573471 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:29.573475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:29.573502 (+ 27us) server_negotiation.cc:407] Connection header received
0806 11:47:29.573737 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:29.573741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:29.573994 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:29.574148 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:29.574754 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.575450 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.576691 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:29.577138 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:29.577274 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:29.581175 (+ 3901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:60423: BlockingRecv error: recv got EOF from 127.26.172.195:60423 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 06 11:47:30 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:30 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:30.076759 7190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:30.069445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:46773)
0806 11:47:30.069814 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:30.069835 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:30.069986 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:30.070279 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:30.070282 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:30.070530 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:30.070730 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:30.070737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.071748 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.071752 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:30.072477 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:30.072488 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.073089 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.073093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:30.073178 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:30.073840 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:30.073854 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:30.076618 (+ 2764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":118,"threads_started":1}
W20260806 11:47:30.077230 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:30.069519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:46773 (local address 127.26.172.254:34543)
0806 11:47:30.069707 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:30.069713 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:30.069923 (+ 210us) server_negotiation.cc:407] Connection header received
0806 11:47:30.070091 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:30.070093 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:30.070155 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:30.070228 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:30.070961 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.071582 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.072629 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.072857 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.072961 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:30.077032 (+ 4071us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:46773: BlockingRecv error: recv got EOF from 127.26.172.193:46773 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 11:47:30 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:30 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:30.349805 7191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:30.341813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:33059)
0806 11:47:30.342144 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:30.342171 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:30.342277 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:30.342710 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:30.342713 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:30.343020 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:30.343149 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:30.343156 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.344187 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.344190 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:30.345046 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:30.345060 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.345806 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.345811 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:30.345906 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:30.346713 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:30.346727 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:30.349545 (+ 2818us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":139,"threads_started":1}
W20260806 11:47:30.349876 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:30.342139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:33059 (local address 127.26.172.254:34543)
0806 11:47:30.342320 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:30.342324 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:30.342344 (+ 20us) server_negotiation.cc:407] Connection header received
0806 11:47:30.342416 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:30.342419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:30.342479 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:30.342602 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:30.343366 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.344006 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.345236 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.345670 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.345864 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:30.349738 (+ 3874us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:33059: BlockingRecv error: recv got EOF from 127.26.172.194:33059 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 06 11:47:30 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:30 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:30.590237 7192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:30.582386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:41633)
0806 11:47:30.582801 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:30.582868 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:30.583035 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:30.583560 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:30.583563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:30.583854 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:30.584022 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:30.584028 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.585004 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.585009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:30.585909 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:30.585926 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.586624 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.586627 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:30.586709 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:30.587554 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:30.587568 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:30.590043 (+ 2475us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":158,"threads_started":1}
W20260806 11:47:30.591006 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:30.582567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:41633 (local address 127.26.172.254:34543)
0806 11:47:30.582748 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:30.582752 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:30.582983 (+ 231us) server_negotiation.cc:407] Connection header received
0806 11:47:30.583204 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:30.583207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:30.583266 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:30.583418 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:30.584179 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.584796 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.586100 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:30.586361 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:30.586498 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:30.590623 (+ 4125us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:41633: BlockingRecv error: recv got EOF from 127.26.172.195:41633 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 11:47:31 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:31 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:31.085817 7193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:31.078242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:46813)
0806 11:47:31.078725 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:31.078747 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:31.078974 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:31.079333 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:31.079335 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:31.079625 (+ 290us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:31.079771 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:31.079779 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.080806 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.080813 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:31.081465 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:31.081474 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.082045 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.082059 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:31.082161 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:31.082879 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:31.082892 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:31.085658 (+ 2766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":108,"threads_started":1}
W20260806 11:47:31.086122 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:31.078496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:46813 (local address 127.26.172.254:34543)
0806 11:47:31.078775 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:31.078780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:31.078974 (+ 194us) server_negotiation.cc:407] Connection header received
0806 11:47:31.079089 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:31.079091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:31.079155 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:31.079262 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:31.079963 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.080671 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.081614 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.081845 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.081964 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:31.085929 (+ 3965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:46813: BlockingRecv error: recv got EOF from 127.26.172.193:46813 (error 108)
Metrics: {"server-negotiator.queue_time_us":155}
Aug 06 11:47:31 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:31 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:31.359163 7194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:31.351272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:50441)
0806 11:47:31.351608 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:31.351623 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:31.351730 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:31.352080 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:31.352082 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:31.352380 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:31.352505 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:31.352512 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.353575 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.353578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:31.354183 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:31.354192 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.354813 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.354816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:31.355042 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:31.355812 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:31.355827 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:31.358951 (+ 3124us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":88,"threads_started":1}
W20260806 11:47:31.359321 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:31.351438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:50441 (local address 127.26.172.254:34543)
0806 11:47:31.351620 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:31.351624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:31.351708 (+ 84us) server_negotiation.cc:407] Connection header received
0806 11:47:31.351821 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:31.351823 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:31.351882 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:31.351987 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:31.352742 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.353378 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.354346 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.354648 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.354773 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:31.359147 (+ 4374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:50441: BlockingRecv error: recv got EOF from 127.26.172.194:50441 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 11:47:31 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:31 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:31.598661 7195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:31.591540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:56703)
0806 11:47:31.591889 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:31.591936 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:31.592066 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:31.592491 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:31.592496 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:31.592784 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:31.592915 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:31.592923 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.594226 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.594230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:31.594995 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:31.595006 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.595531 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.595534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:31.595606 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:31.596266 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:31.596279 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:31.598510 (+ 2231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":141,"threads_started":1}
W20260806 11:47:31.599305 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:31.591875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:56703 (local address 127.26.172.254:34543)
0806 11:47:31.592114 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:31.592118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:31.592134 (+ 16us) server_negotiation.cc:407] Connection header received
0806 11:47:31.592186 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:31.592189 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:31.592278 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:31.592395 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:31.593150 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.594051 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.595149 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:31.595388 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:31.595488 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:31.599105 (+ 3617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:56703: BlockingRecv error: recv got EOF from 127.26.172.195:56703 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 06 11:47:32 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:32 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:32.094486 7196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:32.087157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:42859)
0806 11:47:32.087529 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:32.087544 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:32.087659 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:32.088076 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:32.088079 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:32.088290 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:32.088491 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:32.088499 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.089446 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.089449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:32.090069 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:32.090079 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.090758 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.090764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:32.090930 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:32.091692 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:32.091706 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:32.094250 (+ 2544us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":138,"threads_started":1}
W20260806 11:47:32.094588 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:32.087452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:42859 (local address 127.26.172.254:34543)
0806 11:47:32.087641 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:32.087645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:32.087668 (+ 23us) server_negotiation.cc:407] Connection header received
0806 11:47:32.087793 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:32.087796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:32.087857 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:32.087982 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:32.088649 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.089285 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.090299 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.090542 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.090694 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:32.094448 (+ 3754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:42859: BlockingRecv error: recv got EOF from 127.26.172.193:42859 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 06 11:47:32 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:32 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:32.367506 7198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:32.360303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:55517)
0806 11:47:32.360656 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:32.360672 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:32.360780 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:32.361139 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:32.361141 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:32.361352 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:32.361471 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:32.361477 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.362640 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.362643 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:32.363358 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:32.363370 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.364079 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.364082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:32.364163 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:32.364910 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:32.364923 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:32.367312 (+ 2389us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":152,"threads_started":1}
W20260806 11:47:32.367753 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:32.360530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:55517 (local address 127.26.172.254:34543)
0806 11:47:32.360722 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:32.360727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:32.360752 (+ 25us) server_negotiation.cc:407] Connection header received
0806 11:47:32.360904 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:32.360907 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:32.360970 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:32.361088 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:32.361848 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.362468 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.363549 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.363893 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.364046 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:32.367579 (+ 3533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:55517: BlockingRecv error: recv got EOF from 127.26.172.194:55517 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 06 11:47:32 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:32 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:32.608193 7199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:32.600225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:35213)
0806 11:47:32.600701 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:32.600722 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:32.600949 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:32.601862 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:32.601865 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:32.602259 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:32.602415 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:32.602423 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.603582 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.603585 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:32.604208 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:32.604218 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.604709 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.604713 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:32.604795 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:32.605508 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:32.605520 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:32.607981 (+ 2461us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":156,"threads_started":1}
W20260806 11:47:32.608243 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:32.600461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:35213 (local address 127.26.172.254:34543)
0806 11:47:32.600701 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:32.600708 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:32.600857 (+ 149us) server_negotiation.cc:407] Connection header received
0806 11:47:32.601367 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:32.601376 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:32.601443 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:32.601826 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:32.602568 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.603403 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.604343 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:32.604580 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:32.604704 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:32.608122 (+ 3418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:35213: BlockingRecv error: recv got EOF from 127.26.172.195:35213 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 06 11:47:33 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:33 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:33.103982 7200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:33.095720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:47927)
0806 11:47:33.096208 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:33.096232 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:33.096456 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:33.096948 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:33.096952 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:33.097234 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:33.097373 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:33.097410 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.098585 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.098589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:33.099460 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:33.099475 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.100145 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.100149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:33.100236 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:33.100990 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:33.101003 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:33.103729 (+ 2726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":132,"threads_started":1}
W20260806 11:47:33.104003 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:33.095968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:47927 (local address 127.26.172.254:34543)
0806 11:47:33.096209 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:33.096217 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:33.096360 (+ 143us) server_negotiation.cc:407] Connection header received
0806 11:47:33.096693 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:33.096697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:33.096768 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:33.096891 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:33.097556 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.098417 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.099638 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.099904 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.100014 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:33.103892 (+ 3878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:47927: BlockingRecv error: recv got EOF from 127.26.172.193:47927 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 06 11:47:33 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:33 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:33.376485 7203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:33.368858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:34337)
0806 11:47:33.369343 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:33.369361 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:33.369502 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:33.370028 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:33.370031 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:33.370299 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:33.370416 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:33.370422 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.371536 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.371539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:33.372135 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:33.372144 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.372734 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.372738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:33.372818 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:33.373438 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:33.373450 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:33.376263 (+ 2813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":185,"threads_started":1}
W20260806 11:47:33.376669 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:33.368956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:34337 (local address 127.26.172.254:34543)
0806 11:47:33.369192 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:33.369198 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:33.369498 (+ 300us) server_negotiation.cc:407] Connection header received
0806 11:47:33.369707 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:33.369711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:33.369778 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:33.369884 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:33.370690 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.371382 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.372286 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.372586 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.372707 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:33.376502 (+ 3795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:34337: BlockingRecv error: recv got EOF from 127.26.172.194:34337 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 06 11:47:33 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:33 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:33.617122 7204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:33.609497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:42193)
0806 11:47:33.609967 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:33.609986 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:33.610186 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:33.610816 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:33.610878 (+ 62us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:33.611197 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:33.611314 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:33.611321 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.612189 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.612194 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:33.612848 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:33.612857 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.613397 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.613401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:33.613495 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:33.614261 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:33.614275 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:33.616898 (+ 2623us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":111,"threads_started":1}
W20260806 11:47:33.617201 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:33.609675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:42193 (local address 127.26.172.254:34543)
0806 11:47:33.609879 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:33.609883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:33.610101 (+ 218us) server_negotiation.cc:407] Connection header received
0806 11:47:33.610529 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:33.610534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:33.610618 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:33.610781 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:33.611458 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.612045 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.612990 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:33.613238 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:33.613387 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:33.617069 (+ 3682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:42193: BlockingRecv error: recv got EOF from 127.26.172.195:42193 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 06 11:47:34 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:34 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:34.111979 7205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:34.105026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:34371)
0806 11:47:34.105471 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:34.105489 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:34.105669 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:34.105973 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:34.105976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:34.106264 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:34.106384 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:34.106390 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.107374 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.107379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:34.107991 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:34.108000 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.108546 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.108550 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:34.108642 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:34.109345 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:34.109358 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:34.111731 (+ 2373us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":99,"threads_started":1}
W20260806 11:47:34.112051 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:34.105151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:34371 (local address 127.26.172.254:34543)
0806 11:47:34.105377 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:34.105382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:34.105643 (+ 261us) server_negotiation.cc:407] Connection header received
0806 11:47:34.105773 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:34.105778 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:34.105840 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:34.105942 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:34.106512 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.107238 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.108136 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.108376 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.108498 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:34.111911 (+ 3413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:34371: BlockingRecv error: recv got EOF from 127.26.172.193:34371 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 06 11:47:34 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:34 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:34.392158 7206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:34.377824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:33517)
0806 11:47:34.378340 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:34.378366 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:34.378609 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:34.379068 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:34.379072 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:34.379416 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:34.379559 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:34.379567 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.380551 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.380558 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:34.381233 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:34.381243 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.381856 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.381861 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:34.381960 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:34.388931 (+ 6971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:34.388955 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:34.391905 (+ 2950us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":104,"threads_started":1}
W20260806 11:47:34.392311 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:34.378222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:33517 (local address 127.26.172.254:34543)
0806 11:47:34.378438 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:34.378447 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:34.378471 (+ 24us) server_negotiation.cc:407] Connection header received
0806 11:47:34.378779 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:34.378784 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:34.378889 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:34.379020 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:34.379728 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.380386 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.381392 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.381672 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.381835 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:34.392164 (+ 10329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:33517: BlockingRecv error: recv got EOF from 127.26.172.194:33517 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 06 11:47:34 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:34 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:34.626878 7207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:34.619039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:58917)
0806 11:47:34.619483 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:34.619506 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:34.619652 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:34.620149 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:34.620152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:34.620384 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:34.620506 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:34.620512 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.621454 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.621458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:34.622151 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:34.622162 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.622742 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.622744 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:34.622819 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:34.623576 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:34.623589 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:34.626621 (+ 3032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":115,"threads_started":1}
W20260806 11:47:34.626936 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:34.619315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:58917 (local address 127.26.172.254:34543)
0806 11:47:34.619558 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:34.619563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:34.619584 (+ 21us) server_negotiation.cc:407] Connection header received
0806 11:47:34.619845 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:34.619849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:34.619915 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:34.620040 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:34.620667 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.621289 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.622314 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:34.622557 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:34.622718 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:34.626791 (+ 4073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:58917: BlockingRecv error: recv got EOF from 127.26.172.195:58917 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 06 11:47:35 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:35 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:35.122241 7208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:35.113555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:58339)
0806 11:47:35.114096 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:35.114116 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:35.114241 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:35.114717 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:35.114721 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:35.115073 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:35.115208 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:35.115214 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.116274 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.116276 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:35.116899 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:35.116909 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.117618 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.117621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:35.117693 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:35.119264 (+ 1571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:35.119277 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:35.122073 (+ 2796us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":126,"threads_started":1}
W20260806 11:47:35.122614 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:35.113804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:58339 (local address 127.26.172.254:34543)
0806 11:47:35.114165 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:35.114173 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:35.114197 (+ 24us) server_negotiation.cc:407] Connection header received
0806 11:47:35.114376 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:35.114379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:35.114451 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:35.114601 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:35.115355 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.116112 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.117120 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.117428 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.117562 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:35.122420 (+ 4858us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:58339: BlockingRecv error: recv got EOF from 127.26.172.193:58339 (error 108)
Metrics: {"server-negotiator.queue_time_us":176}
Aug 06 11:47:35 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:35 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:35.401424 7211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:35.393485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:39153)
0806 11:47:35.394004 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:35.394021 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:35.394201 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:35.394549 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:35.394552 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:35.394799 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:35.394986 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:35.394993 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.395946 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.395950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:35.396627 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:35.396637 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.397292 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.397296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:35.397390 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:35.398248 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:35.398274 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:35.401215 (+ 2941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":137,"threads_started":1}
W20260806 11:47:35.401721 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:35.393640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:39153 (local address 127.26.172.254:34543)
0806 11:47:35.393896 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:35.393902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:35.394120 (+ 218us) server_negotiation.cc:407] Connection header received
0806 11:47:35.394323 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:35.394336 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:35.394408 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:35.394511 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:35.395120 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.395803 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.396775 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.397049 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.397289 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:35.401502 (+ 4213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:39153: BlockingRecv error: recv got EOF from 127.26.172.194:39153 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 06 11:47:35 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:35 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.195@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:35.637250 7212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:35.628416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.195:45521)
0806 11:47:35.628932 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:35.628955 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:35.629148 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:35.629761 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:35.629765 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:35.630028 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:35.630175 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:35.630182 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.631323 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.631327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:35.632192 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:35.632205 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.632889 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.632903 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:35.633121 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:35.634006 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:35.634024 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:35.637035 (+ 3011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":140,"threads_started":1}
W20260806 11:47:35.637521 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:35.628509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:45521 (local address 127.26.172.254:34543)
0806 11:47:35.628712 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:35.628717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:35.629066 (+ 349us) server_negotiation.cc:407] Connection header received
0806 11:47:35.629306 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:35.629310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:35.629416 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:35.629604 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:35.630349 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.631131 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.632382 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:35.632643 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:35.632758 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:35.637313 (+ 4555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.195:45521: BlockingRecv error: recv got EOF from 127.26.172.195:45521 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 06 11:47:36 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:36 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.193@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:36.131220 7213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:36.123683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.193:53587)
0806 11:47:36.124128 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:36.124145 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:36.124304 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:36.124670 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:36.124673 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:36.124935 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:36.125070 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:36.125078 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:36.125978 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:36.125981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:36.126671 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:36.126681 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:36.127307 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:36.127310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:36.127387 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:36.128203 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:36.128217 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:36.131055 (+ 2838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":134,"threads_started":1}
W20260806 11:47:36.131415 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:36.123818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:53587 (local address 127.26.172.254:34543)
0806 11:47:36.124027 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:36.124032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:36.124291 (+ 259us) server_negotiation.cc:407] Connection header received
0806 11:47:36.124405 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:36.124408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:36.124469 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:36.124579 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:36.125247 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:36.125800 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:36.126895 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:36.127145 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:36.127257 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:36.131255 (+ 3998us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.193:53587: BlockingRecv error: recv got EOF from 127.26.172.193:53587 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 06 11:47:36 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
Aug 06 11:47:36 dist-test-slave-7z32 krb5kdc[5818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.172.194@KRBTEST.COM for oryx/127.26.172.254@KRBTEST.COM, Server not found in Kerberos database
I20260806 11:47:36.411444 7215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:36.403063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:34543 (local address 127.26.172.194:36867)
0806 11:47:36.403466 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:36.403483 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:36.403621 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:36.404058 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:36.404060 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:36.404284 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:36.404404 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:36.404409 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:36.405616 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:36.405619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:36.406279 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:36.406290 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:36.406987 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:36.406995 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:36.407102 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:36.408134 (+ 1032us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:36.408155 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:36.411206 (+ 3051us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.172.254:34543: Server oryx/127.26.172.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":118,"threads_started":1}
W20260806 11:47:36.411805 6803 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:36.403238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:36867 (local address 127.26.172.254:34543)
0806 11:47:36.403462 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:36.403466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:36.403652 (+ 186us) server_negotiation.cc:407] Connection header received
0806 11:47:36.403736 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:36.403740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:36.403801 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:36.403928 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:36.404622 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:36.405271 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:36.406452 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:36.406708 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:36.406924 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:36.411551 (+ 4627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.172.194:36867: BlockingRecv error: recv got EOF from 127.26.172.194:36867 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 11:47:36.486541 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 6578
I20260806 11:47:36.519080 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 6804
I20260806 11:47:36.537746 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 6993
I20260806 11:47:36.563342 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 6476
2026-08-06T11:47:36Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (19221 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T11:47:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:36Z Disabled control of system clock
I20260806 11:47:36.616214 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46721
--webserver_interface=127.26.172.254
--webserver_port=0
--builtin_ntp_servers=127.26.172.212:42895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:46721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 11:47:36.754890 7219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:36.755404 7219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:36.755502 7219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:36.760263 7219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:36.760368 7219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:36.760385 7219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:36.760403 7219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:36.760419 7219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:36.766039 7219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:42895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:46721
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:36.767518 7219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:36.769182 7219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:36.781812 7224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:36.781781 7227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:36.781849 7219 server_base.cc:1034] running on GCE node
W20260806 11:47:36.781787 7225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:36.782940 7219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:36.784303 7219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:36.787676 7219 hybrid_clock.cc:648] HybridClock initialized: now 1786016856787610 us; error 88 us; skew 500 ppm
I20260806 11:47:36.790500 7219 webserver.cc:460] Webserver started at http://127.26.172.254:35115/ using document root <none> and password file <none>
I20260806 11:47:36.791486 7219 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:36.791575 7219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:36.791857 7219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:36.794318 7219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "64b47396e89f401db6ed79114e1f351f"
format_stamp: "Formatted at 2026-08-06 11:47:36 on dist-test-slave-7z32"
server_key: "66757d98b0f9772e75d8bfeec4ee6f0e"
server_key_iv: "121ff0df03ba3d3ca180f338a3d076ca"
server_key_version: "encryptionkey@0"
I20260806 11:47:36.795068 7219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "64b47396e89f401db6ed79114e1f351f"
format_stamp: "Formatted at 2026-08-06 11:47:36 on dist-test-slave-7z32"
server_key: "66757d98b0f9772e75d8bfeec4ee6f0e"
server_key_iv: "121ff0df03ba3d3ca180f338a3d076ca"
server_key_version: "encryptionkey@0"
I20260806 11:47:36.800637 7219 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:47:36.804775 7235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:36.807050 7219 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 11:47:36.807291 7219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "64b47396e89f401db6ed79114e1f351f"
format_stamp: "Formatted at 2026-08-06 11:47:36 on dist-test-slave-7z32"
server_key: "66757d98b0f9772e75d8bfeec4ee6f0e"
server_key_iv: "121ff0df03ba3d3ca180f338a3d076ca"
server_key_version: "encryptionkey@0"
I20260806 11:47:36.807493 7219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:36.844058 7219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:36.845329 7219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:36.845604 7219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:36.856752 7219 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:46721
I20260806 11:47:36.856861 7312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:46721 every 8 connection(s)
I20260806 11:47:36.858210 7219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:36.864442 7313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:36.868387 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 7219
I20260806 11:47:36.868578 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:36.868950 27315 external_mini_cluster.cc:1428] Setting key 4c5f57b29ad35d045ff295c4eec44524
I20260806 11:47:36.876577 7313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f: Bootstrap starting.
I20260806 11:47:36.880800 7313 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:36.882040 7313 log.cc:824] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:36.882404 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:36.871273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55494 (local address 127.26.172.254:46721)
0806 11:47:36.872434 (+ 1161us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:36.872455 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:36.872512 (+ 57us) server_negotiation.cc:407] Connection header received
0806 11:47:36.873501 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:36.873525 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:36.874085 (+ 560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:36.874435 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:36.875162 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:36.876245 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:36.877717 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:36.878483 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:36.878677 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:36.879968 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:36.879974 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:36.879996 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:36.880558 (+ 562us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:36.880641 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:36.880667 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:36.880774 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:36.881089 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 11:47:36.881424 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":237,"threads_started":1}
I20260806 11:47:36.885388 7313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f: No bootstrap required, opened a new log
I20260806 11:47:36.890017 7313 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b47396e89f401db6ed79114e1f351f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46721 } }
I20260806 11:47:36.890352 7313 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:36.890398 7313 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64b47396e89f401db6ed79114e1f351f, State: Initialized, Role: FOLLOWER
I20260806 11:47:36.891058 7313 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b47396e89f401db6ed79114e1f351f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46721 } }
I20260806 11:47:36.891217 7313 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:36.891296 7313 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:36.891434 7313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:36.892719 7313 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b47396e89f401db6ed79114e1f351f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46721 } }
I20260806 11:47:36.893157 7313 leader_election.cc:302] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64b47396e89f401db6ed79114e1f351f; no voters:
I20260806 11:47:36.893596 7313 leader_election.cc:288] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:36.894003 7318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:36.894944 7318 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [term 1 LEADER]: Becoming Leader. State: Replica: 64b47396e89f401db6ed79114e1f351f, State: Running, Role: LEADER
I20260806 11:47:36.895290 7313 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:36.895525 7318 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b47396e89f401db6ed79114e1f351f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46721 } }
I20260806 11:47:36.897959 7321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64b47396e89f401db6ed79114e1f351f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b47396e89f401db6ed79114e1f351f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46721 } } }
I20260806 11:47:36.898514 7321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:36.898150 7323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64b47396e89f401db6ed79114e1f351f. Latest consensus state: current_term: 1 leader_uuid: "64b47396e89f401db6ed79114e1f351f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b47396e89f401db6ed79114e1f351f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46721 } } }
I20260806 11:47:36.898844 7323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f [sys.catalog]: This master's current role is: LEADER
W20260806 11:47:36.902290 7341 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:47:36.902427 7341 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:47:36.902526 7343 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:36.903539 7343 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:36.911847 7343 catalog_manager.cc:1347] Generated new cluster ID: f732d6ea3ea84d7abce1f62bc4fb02b5
I20260806 11:47:36.911969 7343 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:36.950604 7343 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:36.952543 7343 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:36.961010 7343 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64b47396e89f401db6ed79114e1f351f: Generated new TSK 0
I20260806 11:47:36.962707 7343 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:47:36.967461 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46721
--builtin_ntp_servers=127.26.172.212:42895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 11:47:37.148152 7347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:37.148583 7347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:37.148640 7347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:37.153842 7347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:37.153963 7347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:37.154038 7347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:47:37.160504 7347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:42895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:37.162642 7347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:37.165457 7347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:37.180606 7362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:37.180837 7358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:37.181121 7356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:37.181084 7347 server_base.cc:1034] running on GCE node
I20260806 11:47:37.181962 7347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:37.183003 7347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:37.184295 7347 hybrid_clock.cc:648] HybridClock initialized: now 1786016857184238 us; error 87 us; skew 500 ppm
I20260806 11:47:37.187666 7347 webserver.cc:460] Webserver started at http://127.26.172.193:34893/ using document root <none> and password file <none>
I20260806 11:47:37.188647 7347 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:37.188745 7347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:37.189080 7347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:37.192410 7347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "3f347fc6fe3345e7b56b1eea445b1ae4"
format_stamp: "Formatted at 2026-08-06 11:47:37 on dist-test-slave-7z32"
server_key: "6c0d57d1aad34804690974431b798aad"
server_key_iv: "713e295bd657f7a4479f1c88a9542cfb"
server_key_version: "encryptionkey@0"
I20260806 11:47:37.193337 7347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "3f347fc6fe3345e7b56b1eea445b1ae4"
format_stamp: "Formatted at 2026-08-06 11:47:37 on dist-test-slave-7z32"
server_key: "6c0d57d1aad34804690974431b798aad"
server_key_iv: "713e295bd657f7a4479f1c88a9542cfb"
server_key_version: "encryptionkey@0"
I20260806 11:47:37.200199 7347 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 11:47:37.204754 7369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:37.207021 7347 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260806 11:47:37.207257 7347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "3f347fc6fe3345e7b56b1eea445b1ae4"
format_stamp: "Formatted at 2026-08-06 11:47:37 on dist-test-slave-7z32"
server_key: "6c0d57d1aad34804690974431b798aad"
server_key_iv: "713e295bd657f7a4479f1c88a9542cfb"
server_key_version: "encryptionkey@0"
I20260806 11:47:37.207458 7347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:37.236824 7347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:37.238085 7347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:37.238431 7347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:37.239624 7347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:37.241457 7347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:37.241575 7347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:37.241657 7347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:37.241716 7347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:37.255890 7347 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:39017
I20260806 11:47:37.255954 7521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:39017 every 8 connection(s)
I20260806 11:47:37.257768 7347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:47:37.262961 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 7347
I20260806 11:47:37.263121 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:47:37.263559 27315 external_mini_cluster.cc:1428] Setting key 46277dfb80f9622e43235e693153a087
I20260806 11:47:37.267791 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46721
--builtin_ntp_servers=127.26.172.212:42895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 11:47:37.274449 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:37.260985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:45135 (local address 127.26.172.254:46721)
0806 11:47:37.261247 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:37.261252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:37.263458 (+ 2206us) server_negotiation.cc:407] Connection header received
0806 11:47:37.265842 (+ 2384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:37.265847 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:37.265908 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:37.265987 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:37.267384 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.268884 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.271051 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.271514 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.271716 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:37.273575 (+ 1859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:37.273583 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:37.273598 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:37.273628 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:37.273671 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:37.273689 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:37.273788 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:37.274025 (+ 237us) server_negotiation.cc:299] Negotiation successful
0806 11:47:37.274156 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260806 11:47:37.275655 7525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:37.261745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46721 (local address 127.26.172.193:45135)
0806 11:47:37.263183 (+ 1438us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:37.263278 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:37.265495 (+ 2217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:37.266224 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:37.266233 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:37.266346 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:37.267125 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:37.267152 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.269155 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.269163 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:37.270762 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:37.270781 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.271813 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.271816 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:37.272088 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:37.273108 (+ 1020us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:47:37.273110 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:37.273170 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:47:37.273273 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:37.273812 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:37.273826 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:37.273831 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 11:47:37.273965 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 11:47:37.274302 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":206,"threads_started":1}
I20260806 11:47:37.278088 7523 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46721
I20260806 11:47:37.278465 7523 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:37.279546 7523 heartbeater.cc:511] Master 127.26.172.254:46721 requested a full tablet report, sending...
I20260806 11:47:37.283030 7254 ts_manager.cc:194] Registered new tserver with Master: 3f347fc6fe3345e7b56b1eea445b1ae4 (127.26.172.193:39017)
I20260806 11:47:37.284830 7254 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.193:45135
W20260806 11:47:37.441839 7526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:37.442273 7526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:37.442317 7526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:37.447439 7526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:37.447577 7526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:37.447757 7526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:47:37.453977 7526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:42895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:37.455787 7526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:37.457824 7526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:37.473526 7532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:37.473558 7533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:37.473630 7526 server_base.cc:1034] running on GCE node
W20260806 11:47:37.473526 7535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:37.474481 7526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:37.475374 7526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:37.476742 7526 hybrid_clock.cc:648] HybridClock initialized: now 1786016857476709 us; error 55 us; skew 500 ppm
I20260806 11:47:37.479529 7526 webserver.cc:460] Webserver started at http://127.26.172.194:36629/ using document root <none> and password file <none>
I20260806 11:47:37.480335 7526 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:37.480437 7526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:37.480703 7526 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:37.483502 7526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "0d4677f3a1a246b1b661b9f3f2226c94"
format_stamp: "Formatted at 2026-08-06 11:47:37 on dist-test-slave-7z32"
server_key: "8fcab43a648fdbbb18158241b08a3161"
server_key_iv: "16a735573aeffd40e53ff44d191f49b1"
server_key_version: "encryptionkey@0"
I20260806 11:47:37.484189 7526 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "0d4677f3a1a246b1b661b9f3f2226c94"
format_stamp: "Formatted at 2026-08-06 11:47:37 on dist-test-slave-7z32"
server_key: "8fcab43a648fdbbb18158241b08a3161"
server_key_iv: "16a735573aeffd40e53ff44d191f49b1"
server_key_version: "encryptionkey@0"
I20260806 11:47:37.489507 7526 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:47:37.493893 7548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:37.496222 7526 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:37.496450 7526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "0d4677f3a1a246b1b661b9f3f2226c94"
format_stamp: "Formatted at 2026-08-06 11:47:37 on dist-test-slave-7z32"
server_key: "8fcab43a648fdbbb18158241b08a3161"
server_key_iv: "16a735573aeffd40e53ff44d191f49b1"
server_key_version: "encryptionkey@0"
I20260806 11:47:37.496624 7526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:37.515962 7526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:37.516919 7526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:37.517208 7526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:37.518564 7526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:37.520450 7526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:37.520591 7526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:37.520685 7526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:37.520753 7526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:37.534881 7704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:37661 every 8 connection(s)
I20260806 11:47:37.534787 7526 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:37661
I20260806 11:47:37.536754 7526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:47:37.541500 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 7526
I20260806 11:47:37.541684 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:47:37.542057 27315 external_mini_cluster.cc:1428] Setting key a5e09e104ea5f191323fa86b9aa01b4b
I20260806 11:47:37.545081 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46721
--builtin_ntp_servers=127.26.172.212:42895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 11:47:37.552346 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:37.539808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:39879 (local address 127.26.172.254:46721)
0806 11:47:37.540040 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:37.540046 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:37.542065 (+ 2019us) server_negotiation.cc:407] Connection header received
0806 11:47:37.544069 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:37.544075 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:37.544148 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:37.544296 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:37.547006 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.547788 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.549417 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.549675 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.549809 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:37.551616 (+ 1807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:37.551619 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:37.551622 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:37.551641 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:37.551667 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:37.551676 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:37.551827 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:37.552036 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 11:47:37.552139 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 11:47:37.553675 7707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:37.540539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46721 (local address 127.26.172.194:39879)
0806 11:47:37.541813 (+ 1274us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:37.541896 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:37.543719 (+ 1823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:37.545753 (+ 2034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:37.545770 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:37.545926 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:37.546701 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:37.546720 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.547991 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.547995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:37.549239 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:37.549256 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.549913 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.549918 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:37.550167 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:37.551164 (+ 997us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:47:37.551166 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:37.551251 (+ 85us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:47:37.551363 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:37.551828 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:37.551842 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:37.551852 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 11:47:37.552024 (+ 172us) client_negotiation.cc:240] Negotiation successful
0806 11:47:37.552491 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":215,"threads_started":1}
I20260806 11:47:37.555756 7705 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46721
I20260806 11:47:37.556177 7705 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:37.557178 7705 heartbeater.cc:511] Master 127.26.172.254:46721 requested a full tablet report, sending...
I20260806 11:47:37.559372 7254 ts_manager.cc:194] Registered new tserver with Master: 0d4677f3a1a246b1b661b9f3f2226c94 (127.26.172.194:37661)
I20260806 11:47:37.560271 7254 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.194:39879
W20260806 11:47:37.687523 7709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:37.687884 7709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:37.687923 7709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:37.692296 7709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:37.692396 7709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:37.692456 7709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:47:37.697932 7709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:42895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46721
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:37.699350 7709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:37.701805 7709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:37.716910 7714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:37.716972 7718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:37.716972 7715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:37.717304 7709 server_base.cc:1034] running on GCE node
I20260806 11:47:37.718194 7709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:37.719513 7709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:37.720887 7709 hybrid_clock.cc:648] HybridClock initialized: now 1786016857720835 us; error 104 us; skew 500 ppm
I20260806 11:47:37.723651 7709 webserver.cc:460] Webserver started at http://127.26.172.195:39031/ using document root <none> and password file <none>
I20260806 11:47:37.724434 7709 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:37.724560 7709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:37.724849 7709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:37.727514 7709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "26ae1092bf214a65ae1779dfb447ea03"
format_stamp: "Formatted at 2026-08-06 11:47:37 on dist-test-slave-7z32"
server_key: "e31f1150a2ae57dc7bfd434cbf5f96d2"
server_key_iv: "ab49d53ba453eb38e3fb836e828ccc25"
server_key_version: "encryptionkey@0"
I20260806 11:47:37.728223 7709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "26ae1092bf214a65ae1779dfb447ea03"
format_stamp: "Formatted at 2026-08-06 11:47:37 on dist-test-slave-7z32"
server_key: "e31f1150a2ae57dc7bfd434cbf5f96d2"
server_key_iv: "ab49d53ba453eb38e3fb836e828ccc25"
server_key_version: "encryptionkey@0"
I20260806 11:47:37.733841 7709 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:47:37.737948 7732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:37.740135 7709 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:37.740412 7709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "26ae1092bf214a65ae1779dfb447ea03"
format_stamp: "Formatted at 2026-08-06 11:47:37 on dist-test-slave-7z32"
server_key: "e31f1150a2ae57dc7bfd434cbf5f96d2"
server_key_iv: "ab49d53ba453eb38e3fb836e828ccc25"
server_key_version: "encryptionkey@0"
I20260806 11:47:37.740623 7709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:37.757472 7709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:37.758414 7709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:37.758671 7709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:37.759516 7709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:37.760776 7709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:37.760838 7709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:37.760898 7709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:37.760917 7709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:37.773231 7709 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:37375
I20260806 11:47:37.773257 7888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:37375 every 8 connection(s)
I20260806 11:47:37.774418 7709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:47:37.776552 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 7709
I20260806 11:47:37.776827 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:47:37.777262 27315 external_mini_cluster.cc:1428] Setting key c9353b7a88847df651d769669575bcf8
I20260806 11:47:37.788933 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:37.777692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:57247 (local address 127.26.172.254:46721)
0806 11:47:37.777964 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:37.777971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:37.780246 (+ 2275us) server_negotiation.cc:407] Connection header received
0806 11:47:37.782020 (+ 1774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:37.782024 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:37.782098 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:37.782268 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:37.783756 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.784409 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.785898 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.786219 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.786352 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:37.788144 (+ 1792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:37.788149 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:37.788153 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:37.788177 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:37.788218 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:37.788233 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:37.788356 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:37.788665 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 11:47:37.788763 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 11:47:37.789915 7892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:37.778586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46721 (local address 127.26.172.195:57247)
0806 11:47:37.779936 (+ 1350us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:37.780041 (+ 105us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:37.781729 (+ 1688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:37.782587 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:37.782595 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:37.782706 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:37.783510 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:37.783529 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.784596 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.784600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:37.785702 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:37.785715 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:37.786485 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:37.786489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:37.786701 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:37.787632 (+ 931us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:47:37.787634 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:37.787695 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:47:37.787796 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:37.788405 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:37.788414 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:37.788420 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 11:47:37.788553 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 11:47:37.788847 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":282,"threads_started":1}
I20260806 11:47:37.792436 7889 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46721
I20260806 11:47:37.792956 7889 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:37.794023 7889 heartbeater.cc:511] Master 127.26.172.254:46721 requested a full tablet report, sending...
I20260806 11:47:37.795884 7254 ts_manager.cc:194] Registered new tserver with Master: 26ae1092bf214a65ae1779dfb447ea03 (127.26.172.195:37375)
I20260806 11:47:37.796667 7254 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.195:57247
I20260806 11:47:37.807155 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 11:47:37.811278 7316 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:37.809905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55508 (local address 127.26.172.254:46721)
0806 11:47:37.810184 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:37.810189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:37.810362 (+ 173us) server_negotiation.cc:407] Connection header received
0806 11:47:37.810585 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:37.810588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:37.810639 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:37.810746 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:37.811100 (+ 354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55508: BlockingRecv error: recv got EOF from 127.0.0.1:55508 (error 108)
Metrics: {"server-negotiator.queue_time_us":144}
I20260806 11:47:37.811925 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 7347
I20260806 11:47:37.830936 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 7526
I20260806 11:47:37.857275 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 7709
I20260806 11:47:37.879040 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 7219
2026-08-06T11:47:37Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (1313 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T11:47:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:37Z Disabled control of system clock
I20260806 11:47:37.931825 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40145
--webserver_interface=127.26.172.254
--webserver_port=0
--builtin_ntp_servers=127.26.172.212:35303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:40145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 11:47:38.092510 7906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:38.093106 7906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:38.093253 7906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:38.098379 7906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:38.098506 7906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:38.098523 7906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:38.098543 7906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:38.098562 7906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:38.104768 7906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:35303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:40145
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:38.106532 7906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:38.108609 7906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:38.122653 7913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:38.122627 7917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:38.122628 7914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:38.123286 7906 server_base.cc:1034] running on GCE node
I20260806 11:47:38.124660 7906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:38.126710 7906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:38.128181 7906 hybrid_clock.cc:648] HybridClock initialized: now 1786016858128148 us; error 65 us; skew 500 ppm
I20260806 11:47:38.131481 7906 webserver.cc:460] Webserver started at http://127.26.172.254:34405/ using document root <none> and password file <none>
I20260806 11:47:38.132481 7906 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:38.132615 7906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:38.132975 7906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:38.137276 7906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "5ac63270f57c4c8ea250b5a6bb54837c"
format_stamp: "Formatted at 2026-08-06 11:47:38 on dist-test-slave-7z32"
server_key: "6d25b9891e0e51f33f5661e74c9a2213"
server_key_iv: "cdbc8b33c3e7f1bdedc11b690e3eb120"
server_key_version: "encryptionkey@0"
I20260806 11:47:38.139279 7906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "5ac63270f57c4c8ea250b5a6bb54837c"
format_stamp: "Formatted at 2026-08-06 11:47:38 on dist-test-slave-7z32"
server_key: "6d25b9891e0e51f33f5661e74c9a2213"
server_key_iv: "cdbc8b33c3e7f1bdedc11b690e3eb120"
server_key_version: "encryptionkey@0"
I20260806 11:47:38.148360 7906 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.001s
I20260806 11:47:38.153014 7926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:38.155434 7906 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:38.155709 7906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "5ac63270f57c4c8ea250b5a6bb54837c"
format_stamp: "Formatted at 2026-08-06 11:47:38 on dist-test-slave-7z32"
server_key: "6d25b9891e0e51f33f5661e74c9a2213"
server_key_iv: "cdbc8b33c3e7f1bdedc11b690e3eb120"
server_key_version: "encryptionkey@0"
I20260806 11:47:38.155922 7906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:38.163822 7906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:38.164791 7906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:38.165042 7906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:38.177024 7906 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:40145
I20260806 11:47:38.177161 7993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:40145 every 8 connection(s)
I20260806 11:47:38.178668 7906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:38.183904 7995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:38.184829 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 7906
I20260806 11:47:38.184990 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:38.185359 27315 external_mini_cluster.cc:1428] Setting key 470f93a334247bd9157c4bcd66b00839
I20260806 11:47:38.193781 7995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c: Bootstrap starting.
I20260806 11:47:38.194985 7999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:38.188127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53724 (local address 127.26.172.254:40145)
0806 11:47:38.189325 (+ 1198us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:38.189349 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:38.189405 (+ 56us) server_negotiation.cc:407] Connection header received
0806 11:47:38.190320 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:38.190346 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:38.191015 (+ 669us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:38.191461 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:38.192608 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:38.192615 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:38.192632 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:38.192646 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:38.192720 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:38.192740 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:38.192903 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:38.193275 (+ 372us) server_negotiation.cc:299] Negotiation successful
0806 11:47:38.193803 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":370,"threads_started":1}
I20260806 11:47:38.196939 7995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:38.197849 7995 log.cc:824] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:38.201071 7995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c: No bootstrap required, opened a new log
I20260806 11:47:38.205749 7995 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac63270f57c4c8ea250b5a6bb54837c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40145 } }
I20260806 11:47:38.206060 7995 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:38.206097 7995 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ac63270f57c4c8ea250b5a6bb54837c, State: Initialized, Role: FOLLOWER
I20260806 11:47:38.206629 7995 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac63270f57c4c8ea250b5a6bb54837c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40145 } }
I20260806 11:47:38.206772 7995 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:38.206875 7995 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:38.207018 7995 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:38.208380 7995 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac63270f57c4c8ea250b5a6bb54837c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40145 } }
I20260806 11:47:38.208861 7995 leader_election.cc:302] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ac63270f57c4c8ea250b5a6bb54837c; no voters:
I20260806 11:47:38.209429 7995 leader_election.cc:288] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:38.209827 8002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:38.210294 8002 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [term 1 LEADER]: Becoming Leader. State: Replica: 5ac63270f57c4c8ea250b5a6bb54837c, State: Running, Role: LEADER
I20260806 11:47:38.210795 8002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac63270f57c4c8ea250b5a6bb54837c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40145 } }
I20260806 11:47:38.211591 7995 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:38.213471 8005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ac63270f57c4c8ea250b5a6bb54837c. Latest consensus state: current_term: 1 leader_uuid: "5ac63270f57c4c8ea250b5a6bb54837c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac63270f57c4c8ea250b5a6bb54837c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40145 } } }
I20260806 11:47:38.213692 8005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:38.213388 8003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ac63270f57c4c8ea250b5a6bb54837c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ac63270f57c4c8ea250b5a6bb54837c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40145 } } }
I20260806 11:47:38.213830 8003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c [sys.catalog]: This master's current role is: LEADER
W20260806 11:47:38.219190 8023 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:47:38.219327 8023 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:47:38.219439 8022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:38.220585 8022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:38.229365 8022 catalog_manager.cc:1347] Generated new cluster ID: 0e3786d9d9d04a2ba7f990cdd4c5b9cd
I20260806 11:47:38.229518 8022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:38.253954 8022 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:38.254573 8022 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:38.264104 8022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ac63270f57c4c8ea250b5a6bb54837c: Generated new TSK 0
I20260806 11:47:38.265245 8022 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:47:38.273800 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40145
--builtin_ntp_servers=127.26.172.212:35303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 11:47:38.443037 8028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:38.443516 8028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:38.443569 8028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:38.448447 8028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:38.448586 8028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:38.448665 8028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:47:38.454645 8028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:35303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:38.456499 8028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:38.458530 8028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:38.471907 8038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:38.471864 8037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:38.471876 8040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:38.472306 8028 server_base.cc:1034] running on GCE node
I20260806 11:47:38.473050 8028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:38.474117 8028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:38.475476 8028 hybrid_clock.cc:648] HybridClock initialized: now 1786016858475449 us; error 47 us; skew 500 ppm
I20260806 11:47:38.478344 8028 webserver.cc:460] Webserver started at http://127.26.172.193:45313/ using document root <none> and password file <none>
I20260806 11:47:38.479164 8028 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:38.479255 8028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:38.479481 8028 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:38.481978 8028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "028be9a22f4e4cef9e906142bd052a49"
format_stamp: "Formatted at 2026-08-06 11:47:38 on dist-test-slave-7z32"
server_key: "7e4c4a3f062bc7ce5444b342e060ee9b"
server_key_iv: "5832b6359fa552e428d6a821e2b6077a"
server_key_version: "encryptionkey@0"
I20260806 11:47:38.482589 8028 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "028be9a22f4e4cef9e906142bd052a49"
format_stamp: "Formatted at 2026-08-06 11:47:38 on dist-test-slave-7z32"
server_key: "7e4c4a3f062bc7ce5444b342e060ee9b"
server_key_iv: "5832b6359fa552e428d6a821e2b6077a"
server_key_version: "encryptionkey@0"
I20260806 11:47:38.488401 8028 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:47:38.492336 8047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:38.494427 8028 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:47:38.494604 8028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "028be9a22f4e4cef9e906142bd052a49"
format_stamp: "Formatted at 2026-08-06 11:47:38 on dist-test-slave-7z32"
server_key: "7e4c4a3f062bc7ce5444b342e060ee9b"
server_key_iv: "5832b6359fa552e428d6a821e2b6077a"
server_key_version: "encryptionkey@0"
I20260806 11:47:38.494745 8028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:38.500504 8028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:38.501317 8028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:38.501509 8028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:38.502151 8028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:38.503458 8028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:38.503518 8028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:38.503564 8028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:38.503580 8028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:38.520058 8028 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:43903
I20260806 11:47:38.520162 8200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:43903 every 8 connection(s)
I20260806 11:47:38.521510 8028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:47:38.527947 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 8028
I20260806 11:47:38.528115 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:47:38.528503 27315 external_mini_cluster.cc:1428] Setting key 546660152c01ede47e6e9968ca4ac4b1
I20260806 11:47:38.531250 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40145
--builtin_ntp_servers=127.26.172.212:35303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 11:47:38.531239 7999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:38.524719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:60317 (local address 127.26.172.254:40145)
0806 11:47:38.524906 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:38.524910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:38.527006 (+ 2096us) server_negotiation.cc:407] Connection header received
0806 11:47:38.528747 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:38.528751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:38.528808 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:38.528939 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:38.530585 (+ 1646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:38.530590 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:38.530593 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:38.530612 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:38.530647 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:38.530658 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:38.530784 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:38.531008 (+ 224us) server_negotiation.cc:299] Negotiation successful
0806 11:47:38.531068 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 11:47:38.532495 8204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:38.525406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40145 (local address 127.26.172.193:60317)
0806 11:47:38.526725 (+ 1319us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:38.526788 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:38.528429 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:38.529155 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:38.529164 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:38.529283 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:38.530089 (+ 806us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:47:38.530091 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:38.530152 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:47:38.530258 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:38.530761 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:38.530772 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:38.530778 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 11:47:38.531066 (+ 288us) client_negotiation.cc:240] Negotiation successful
0806 11:47:38.531384 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":260,"threads_started":1}
I20260806 11:47:38.534729 8201 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40145
I20260806 11:47:38.535213 8201 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:38.535892 8201 heartbeater.cc:511] Master 127.26.172.254:40145 requested a full tablet report, sending...
I20260806 11:47:38.538544 7946 ts_manager.cc:194] Registered new tserver with Master: 028be9a22f4e4cef9e906142bd052a49 (127.26.172.193:43903)
W20260806 11:47:38.723762 8205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:38.724239 8205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:38.724298 8205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:38.729504 8205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:38.729629 8205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:38.729707 8205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:47:38.737419 8205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:35303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:38.739130 8205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:38.741155 8205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:38.756400 8215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:38.756400 8211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:38.756811 8217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:38.757045 8205 server_base.cc:1034] running on GCE node
I20260806 11:47:38.757714 8205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:38.758771 8205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:38.760115 8205 hybrid_clock.cc:648] HybridClock initialized: now 1786016858760060 us; error 73 us; skew 500 ppm
I20260806 11:47:38.764349 8205 webserver.cc:460] Webserver started at http://127.26.172.194:42499/ using document root <none> and password file <none>
I20260806 11:47:38.765508 8205 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:38.765659 8205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:38.765964 8205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:38.769196 8205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "8abb12d083cb4568800cf2e624342d03"
format_stamp: "Formatted at 2026-08-06 11:47:38 on dist-test-slave-7z32"
server_key: "0668a878766647933de752bbbddc9710"
server_key_iv: "9f8ff9387c02ad2a5bbbae6c4e9a895f"
server_key_version: "encryptionkey@0"
I20260806 11:47:38.769985 8205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "8abb12d083cb4568800cf2e624342d03"
format_stamp: "Formatted at 2026-08-06 11:47:38 on dist-test-slave-7z32"
server_key: "0668a878766647933de752bbbddc9710"
server_key_iv: "9f8ff9387c02ad2a5bbbae6c4e9a895f"
server_key_version: "encryptionkey@0"
I20260806 11:47:38.776165 8205 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 11:47:38.780865 8227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:38.784049 8205 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260806 11:47:38.784650 8205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "8abb12d083cb4568800cf2e624342d03"
format_stamp: "Formatted at 2026-08-06 11:47:38 on dist-test-slave-7z32"
server_key: "0668a878766647933de752bbbddc9710"
server_key_iv: "9f8ff9387c02ad2a5bbbae6c4e9a895f"
server_key_version: "encryptionkey@0"
I20260806 11:47:38.784880 8205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:38.792543 8205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:38.793596 8205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:38.793877 8205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:38.795053 8205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:38.796610 8205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:38.796703 8205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:38.796784 8205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:38.796830 8205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:38.812963 8205 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:35917
I20260806 11:47:38.813115 8391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:35917 every 8 connection(s)
I20260806 11:47:38.814534 8205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:47:38.816902 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 8205
I20260806 11:47:38.817041 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:47:38.817490 27315 external_mini_cluster.cc:1428] Setting key 2c4282525c4c6db917cd789197f6bd3a
I20260806 11:47:38.820528 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40145
--builtin_ntp_servers=127.26.172.212:35303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 11:47:38.823745 7999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:38.817477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:36853 (local address 127.26.172.254:40145)
0806 11:47:38.817716 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:38.817722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:38.819721 (+ 1999us) server_negotiation.cc:407] Connection header received
0806 11:47:38.821456 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:38.821460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:38.821510 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:38.821595 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:38.823174 (+ 1579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:38.823178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:38.823181 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:38.823205 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:38.823227 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:38.823236 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:38.823356 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:38.823523 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 11:47:38.823588 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260806 11:47:38.824936 8395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:38.818234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40145 (local address 127.26.172.194:36853)
0806 11:47:38.819553 (+ 1319us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:38.819614 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:38.821175 (+ 1561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:38.821801 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:38.821809 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:38.821927 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:38.822754 (+ 827us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:47:38.822756 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:38.822875 (+ 119us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:47:38.822990 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:38.823336 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:38.823347 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:38.823353 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 11:47:38.823577 (+ 224us) client_negotiation.cc:240] Negotiation successful
0806 11:47:38.823909 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":211,"threads_started":1}
I20260806 11:47:38.827186 8393 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40145
I20260806 11:47:38.827634 8393 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:38.828367 8393 heartbeater.cc:511] Master 127.26.172.254:40145 requested a full tablet report, sending...
I20260806 11:47:38.830281 7946 ts_manager.cc:194] Registered new tserver with Master: 8abb12d083cb4568800cf2e624342d03 (127.26.172.194:35917)
W20260806 11:47:38.968214 8396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:38.968642 8396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:38.968688 8396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:38.973843 8396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:38.973932 8396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:38.973997 8396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:47:38.979952 8396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:35303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:38.981370 8396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:38.983155 8396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:38.996807 8403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:38.996899 8396 server_base.cc:1034] running on GCE node
W20260806 11:47:38.996773 8406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:38.996778 8404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:38.997936 8396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:38.999117 8396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:39.000353 8396 hybrid_clock.cc:648] HybridClock initialized: now 1786016859000265 us; error 94 us; skew 500 ppm
I20260806 11:47:39.004186 8396 webserver.cc:460] Webserver started at http://127.26.172.195:34809/ using document root <none> and password file <none>
I20260806 11:47:39.005330 8396 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:39.005486 8396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:39.005837 8396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:39.009223 8396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "3fc945c092834f888d89ff67bf3ce937"
format_stamp: "Formatted at 2026-08-06 11:47:39 on dist-test-slave-7z32"
server_key: "70354b3efc961d131df610f633379c6d"
server_key_iv: "8952f0f45f9603cd3ff515315831ab65"
server_key_version: "encryptionkey@0"
I20260806 11:47:39.010298 8396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "3fc945c092834f888d89ff67bf3ce937"
format_stamp: "Formatted at 2026-08-06 11:47:39 on dist-test-slave-7z32"
server_key: "70354b3efc961d131df610f633379c6d"
server_key_iv: "8952f0f45f9603cd3ff515315831ab65"
server_key_version: "encryptionkey@0"
I20260806 11:47:39.017094 8396 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 11:47:39.022188 8421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:39.024737 8396 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:47:39.025027 8396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "3fc945c092834f888d89ff67bf3ce937"
format_stamp: "Formatted at 2026-08-06 11:47:39 on dist-test-slave-7z32"
server_key: "70354b3efc961d131df610f633379c6d"
server_key_iv: "8952f0f45f9603cd3ff515315831ab65"
server_key_version: "encryptionkey@0"
I20260806 11:47:39.025247 8396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:39.032912 8396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:39.033981 8396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:39.034202 8396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:39.035044 8396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:39.036754 8396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:39.036849 8396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:39.036906 8396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:39.036922 8396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:39.051122 8396 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:35295
I20260806 11:47:39.051168 8581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:35295 every 8 connection(s)
I20260806 11:47:39.053002 8396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:47:39.053676 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 8396
I20260806 11:47:39.053848 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:47:39.054277 27315 external_mini_cluster.cc:1428] Setting key 5a1f6114d6bc373937dc3adc191db647
I20260806 11:47:39.063551 7999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:39.056446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:39453 (local address 127.26.172.254:40145)
0806 11:47:39.056635 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:39.056641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:39.058790 (+ 2149us) server_negotiation.cc:407] Connection header received
0806 11:47:39.060506 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:39.060511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:39.060579 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:39.060762 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:39.062522 (+ 1760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:39.062526 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:39.062529 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:47:39.062550 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:39.062593 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:47:39.062605 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:39.062874 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:39.063141 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 11:47:39.063210 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 11:47:39.064529 8584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:39.057456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40145 (local address 127.26.172.195:39453)
0806 11:47:39.058497 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:39.058568 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:39.060157 (+ 1589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:39.061112 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:39.061121 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:39.061258 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:39.062122 (+ 864us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:47:39.062124 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:39.062181 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:47:39.062282 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:39.062798 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:39.062814 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:39.062862 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 11:47:39.063113 (+ 251us) client_negotiation.cc:240] Negotiation successful
0806 11:47:39.063440 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":204,"threads_started":1}
I20260806 11:47:39.066416 8582 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40145
I20260806 11:47:39.066963 8582 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:39.067833 8582 heartbeater.cc:511] Master 127.26.172.254:40145 requested a full tablet report, sending...
I20260806 11:47:39.069937 7944 ts_manager.cc:194] Registered new tserver with Master: 3fc945c092834f888d89ff67bf3ce937 (127.26.172.195:35295)
I20260806 11:47:39.071713 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 11:47:39.076788 7999 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:47:39.075078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60422 (local address 127.26.172.254:40145)
0806 11:47:39.075312 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:39.075317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:39.075432 (+ 115us) server_negotiation.cc:407] Connection header received
0806 11:47:39.075674 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:39.075679 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:39.075735 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:39.075853 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:39.076506 (+ 653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60422: BlockingRecv error: recv got EOF from 127.0.0.1:60422 (error 108)
Metrics: {"server-negotiator.queue_time_us":112}
I20260806 11:47:39.077067 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 8028
I20260806 11:47:39.097410 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 8205
I20260806 11:47:39.116986 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 8396
I20260806 11:47:39.129999 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 7906
2026-08-06T11:47:39Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (1247 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:47:39 dist-test-slave-7z32 krb5kdc[8595](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:47:39 dist-test-slave-7z32 krb5kdc[8595](info): set up 2 sockets
Aug 06 11:47:39 dist-test-slave-7z32 krb5kdc[8595](info): commencing operation
krb5kdc: starting...
W20260806 11:47:40.537436 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.376s user 0.000s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:47:40 dist-test-slave-7z32 krb5kdc[8595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:47:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:47:40.736243 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:39007
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:39007
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:40.868289 8612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:40.868647 8612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:40.868692 8612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:40.873086 8612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:47:40.873185 8612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:40.873205 8612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:40.873222 8612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:47:40.873238 8612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:47:40.879431 8612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:39007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:39007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:40.880707 8612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:40.881796 8612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:40.892697 8617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:40.892758 8621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:40.892689 8618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:40.893534 8612 server_base.cc:1034] running on GCE node
I20260806 11:47:40.894421 8612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:40.895956 8612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:40.899335 8612 hybrid_clock.cc:648] HybridClock initialized: now 1786016860899296 us; error 98 us; skew 500 ppm
Aug 06 11:47:40 dist-test-slave-7z32 krb5kdc[8595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016860, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:40.909220 8612 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:47:40.910753 8612 webserver.cc:460] Webserver started at http://127.26.172.254:46017/ using document root <none> and password file <none>
I20260806 11:47:40.911629 8612 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:40.911716 8612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:40.912004 8612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:40.914664 8612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "3580549c0e3d4568b9dfaeb12860bb92"
format_stamp: "Formatted at 2026-08-06 11:47:40 on dist-test-slave-7z32"
server_key: "7d1053354f6ebf35140875dbf303c628"
server_key_iv: "f1208a05dd838de6b06579914a3f640b"
server_key_version: "encryptionkey@0"
I20260806 11:47:40.915586 8612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "3580549c0e3d4568b9dfaeb12860bb92"
format_stamp: "Formatted at 2026-08-06 11:47:40 on dist-test-slave-7z32"
server_key: "7d1053354f6ebf35140875dbf303c628"
server_key_iv: "f1208a05dd838de6b06579914a3f640b"
server_key_version: "encryptionkey@0"
I20260806 11:47:40.921700 8612 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260806 11:47:40.925865 8631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:40.928100 8612 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 11:47:40.928336 8612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "3580549c0e3d4568b9dfaeb12860bb92"
format_stamp: "Formatted at 2026-08-06 11:47:40 on dist-test-slave-7z32"
server_key: "7d1053354f6ebf35140875dbf303c628"
server_key_iv: "f1208a05dd838de6b06579914a3f640b"
server_key_version: "encryptionkey@0"
I20260806 11:47:40.928526 8612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:40.943769 8612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:40.948140 8612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:40.948398 8612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:40.958365 8612 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:39007
I20260806 11:47:40.958474 8700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:39007 every 8 connection(s)
I20260806 11:47:40.959789 8612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:47:40.964350 8701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:40.968941 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 8612
I20260806 11:47:40.969142 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:47:40.969507 27315 external_mini_cluster.cc:1428] Setting key 573a791f6544951f3e225ff1d929ec02
I20260806 11:47:40.973852 8701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92: Bootstrap starting.
I20260806 11:47:40.978482 8701 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:40.979950 8701 log.cc:824] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92: Log is configured to *not* fsync() on all Append() calls
Aug 06 11:47:40 dist-test-slave-7z32 krb5kdc[8595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:47:40.984078 8701 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92: No bootstrap required, opened a new log
I20260806 11:47:40.988340 8701 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3580549c0e3d4568b9dfaeb12860bb92" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39007 } }
I20260806 11:47:40.988777 8701 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:40.988855 8701 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3580549c0e3d4568b9dfaeb12860bb92, State: Initialized, Role: FOLLOWER
I20260806 11:47:40.989549 8701 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3580549c0e3d4568b9dfaeb12860bb92" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39007 } }
I20260806 11:47:40.989763 8701 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:47:40.989859 8701 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:47:40.989996 8701 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:40.991887 8701 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3580549c0e3d4568b9dfaeb12860bb92" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39007 } }
I20260806 11:47:40.992038 8706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:40.971861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35578 (local address 127.26.172.254:39007)
0806 11:47:40.972751 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:40.972783 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:40.972833 (+ 50us) server_negotiation.cc:407] Connection header received
0806 11:47:40.974197 (+ 1364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:40.974227 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:40.974814 (+ 587us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:40.975266 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:40.976587 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:40.977885 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:40.979592 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:40.980395 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:40.980637 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:40.984832 (+ 4195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:40.984839 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:40.984863 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:40.984910 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:40.988127 (+ 3217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:40.988823 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:40.988834 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:40.988846 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:40.989050 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:40.989399 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:40.989402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:40.989404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:40.990107 (+ 703us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:40.990391 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:40.990667 (+ 276us) server_negotiation.cc:299] Negotiation successful
0806 11:47:40.991097 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":262,"threads_started":1}
I20260806 11:47:40.992585 8701 leader_election.cc:302] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3580549c0e3d4568b9dfaeb12860bb92; no voters:
I20260806 11:47:40.993141 8701 leader_election.cc:288] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:47:40.993387 8708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:40.993903 8708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [term 1 LEADER]: Becoming Leader. State: Replica: 3580549c0e3d4568b9dfaeb12860bb92, State: Running, Role: LEADER
I20260806 11:47:40.994395 8708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3580549c0e3d4568b9dfaeb12860bb92" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39007 } }
I20260806 11:47:40.995038 8701 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:47:40.997527 8712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3580549c0e3d4568b9dfaeb12860bb92. Latest consensus state: current_term: 1 leader_uuid: "3580549c0e3d4568b9dfaeb12860bb92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3580549c0e3d4568b9dfaeb12860bb92" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39007 } } }
I20260806 11:47:40.998143 8710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3580549c0e3d4568b9dfaeb12860bb92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3580549c0e3d4568b9dfaeb12860bb92" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39007 } } }
I20260806 11:47:40.998379 8712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:40.998471 8710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92 [sys.catalog]: This master's current role is: LEADER
I20260806 11:47:40.998926 8734 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:47:41.003515 8734 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:47:41.011312 8734 catalog_manager.cc:1347] Generated new cluster ID: 37c3573b664f463cae736a31599fa36c
I20260806 11:47:41.011435 8734 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:47:41.037249 8734 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:47:41.038435 8734 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:47:41.046898 8734 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92: Generated new TSK 0
I20260806 11:47:41.048064 8734 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:47:41.121397 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39007
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:41.326028 8743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:41.326486 8743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:41.326546 8743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:41.331684 8743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:41.331816 8743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:41.331895 8743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:47:41.339078 8743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:41.340880 8743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:41.342418 8743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:41.357880 8753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:41.357872 8749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:41.357872 8750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:41.358059 8743 server_base.cc:1034] running on GCE node
I20260806 11:47:41.359110 8743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:41.360400 8743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:41.361655 8743 hybrid_clock.cc:648] HybridClock initialized: now 1786016861361615 us; error 60 us; skew 500 ppm
Aug 06 11:47:41 dist-test-slave-7z32 krb5kdc[8595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016861, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:41.366377 8743 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:47:41.368449 8743 webserver.cc:460] Webserver started at http://127.26.172.193:43219/ using document root <none> and password file <none>
I20260806 11:47:41.369403 8743 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:41.369513 8743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:41.369906 8743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:41.373243 8743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "d617ad35edfe4b43a90155e075783320"
format_stamp: "Formatted at 2026-08-06 11:47:41 on dist-test-slave-7z32"
server_key: "53b7d9d48b1a91033a670897c17c9f75"
server_key_iv: "0b825061c7432c5cbd2fc4a6a5a2f198"
server_key_version: "encryptionkey@0"
I20260806 11:47:41.374153 8743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "d617ad35edfe4b43a90155e075783320"
format_stamp: "Formatted at 2026-08-06 11:47:41 on dist-test-slave-7z32"
server_key: "53b7d9d48b1a91033a670897c17c9f75"
server_key_iv: "0b825061c7432c5cbd2fc4a6a5a2f198"
server_key_version: "encryptionkey@0"
I20260806 11:47:41.380594 8743 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 11:47:41.385169 8761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:41.387061 8743 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:41.387214 8743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "d617ad35edfe4b43a90155e075783320"
format_stamp: "Formatted at 2026-08-06 11:47:41 on dist-test-slave-7z32"
server_key: "53b7d9d48b1a91033a670897c17c9f75"
server_key_iv: "0b825061c7432c5cbd2fc4a6a5a2f198"
server_key_version: "encryptionkey@0"
I20260806 11:47:41.387353 8743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:41.412467 8743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:41.416337 8743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:41.416545 8743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:41.417207 8743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:41.418306 8743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:41.418366 8743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:41.418444 8743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:41.418483 8743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:41.430652 8743 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:33809
I20260806 11:47:41.430708 8912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:33809 every 8 connection(s)
I20260806 11:47:41.431924 8743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:47:41.436510 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 8743
I20260806 11:47:41.436651 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:47:41.436990 27315 external_mini_cluster.cc:1428] Setting key 799df3fea130bb29104d22bdeb56b55f
Aug 06 11:47:41 dist-test-slave-7z32 krb5kdc[8595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016861, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:47:41.455360 8706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:41.434981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:60293 (local address 127.26.172.254:39007)
0806 11:47:41.435215 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:41.435221 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:41.437014 (+ 1793us) server_negotiation.cc:407] Connection header received
0806 11:47:41.438665 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:41.438668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:41.438732 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:41.438932 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:41.441357 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:41.442043 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:41.444540 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:41.444803 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:41.444923 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:41.449168 (+ 4245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:41.449178 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:41.449184 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:41.449241 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:41.451776 (+ 2535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:41.452700 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:41.452708 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:41.452712 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:41.452850 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:41.453408 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:41.453412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:41.453418 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:41.453728 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:41.453840 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:41.454818 (+ 978us) server_negotiation.cc:299] Negotiation successful
0806 11:47:41.455126 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:47:41.456462 8918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:41.435429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:39007 (local address 127.26.172.193:60293)
0806 11:47:41.436721 (+ 1292us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:41.436828 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:41.438326 (+ 1498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:41.439634 (+ 1308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:41.439645 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:41.440104 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:41.441094 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:41.441119 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:41.442273 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:41.442281 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:41.444300 (+ 2019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:41.444326 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:41.445058 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:41.445067 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:41.445405 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:41.446310 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:41.446346 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:41.448820 (+ 2474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:41.452015 (+ 3195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:41.452022 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:41.452043 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:41.452512 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:41.453019 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:41.453022 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:41.453024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:41.453218 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:41.453969 (+ 751us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:41.453981 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:41.454457 (+ 476us) client_negotiation.cc:769] Sending connection context
0806 11:47:41.454673 (+ 216us) client_negotiation.cc:240] Negotiation successful
0806 11:47:41.455090 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"thread_start_us":640,"threads_started":1}
I20260806 11:47:41.458463 8915 heartbeater.cc:347] Connected to a master server at 127.26.172.254:39007
I20260806 11:47:41.459040 8915 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:41.460422 8915 heartbeater.cc:511] Master 127.26.172.254:39007 requested a full tablet report, sending...
I20260806 11:47:41.463287 8651 ts_manager.cc:194] Registered new tserver with Master: d617ad35edfe4b43a90155e075783320 (127.26.172.193:33809)
I20260806 11:47:41.465416 8651 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:60293
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:47:41.485191 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39007
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:41.656982 8921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:41.657429 8921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:41.657490 8921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:41.663609 8921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:41.663759 8921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:41.663844 8921 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:47:41.671455 8921 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:41.673132 8921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:41.674602 8921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:41.693531 8926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:41.693899 8929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:41.693706 8921 server_base.cc:1034] running on GCE node
W20260806 11:47:41.693542 8927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:41.694814 8921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:41.695955 8921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:41.699445 8921 hybrid_clock.cc:648] HybridClock initialized: now 1786016861699384 us; error 88 us; skew 500 ppm
Aug 06 11:47:41 dist-test-slave-7z32 krb5kdc[8595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016861, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:41.708707 8921 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:47:41.710700 8921 webserver.cc:460] Webserver started at http://127.26.172.194:45931/ using document root <none> and password file <none>
I20260806 11:47:41.712365 8921 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:41.712541 8921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:41.712987 8921 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:41.716646 8921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "b92d87eedc83492493ae441ec72070f3"
format_stamp: "Formatted at 2026-08-06 11:47:41 on dist-test-slave-7z32"
server_key: "a1264a7c644f71e29d6f840c308837c9"
server_key_iv: "ccd1502ac2010fdf0709633c803223d9"
server_key_version: "encryptionkey@0"
I20260806 11:47:41.717605 8921 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "b92d87eedc83492493ae441ec72070f3"
format_stamp: "Formatted at 2026-08-06 11:47:41 on dist-test-slave-7z32"
server_key: "a1264a7c644f71e29d6f840c308837c9"
server_key_iv: "ccd1502ac2010fdf0709633c803223d9"
server_key_version: "encryptionkey@0"
I20260806 11:47:41.725265 8921 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260806 11:47:41.729705 8940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:41.732061 8921 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:47:41.732298 8921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "b92d87eedc83492493ae441ec72070f3"
format_stamp: "Formatted at 2026-08-06 11:47:41 on dist-test-slave-7z32"
server_key: "a1264a7c644f71e29d6f840c308837c9"
server_key_iv: "ccd1502ac2010fdf0709633c803223d9"
server_key_version: "encryptionkey@0"
I20260806 11:47:41.732538 8921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:41.762560 8921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:41.767575 8921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:41.767877 8921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:41.768826 8921 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:41.770109 8921 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:41.770365 8921 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:41.770635 8921 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:41.770690 8921 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:41.788523 8921 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:33505
I20260806 11:47:41.788569 9098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:33505 every 8 connection(s)
I20260806 11:47:41.790628 8921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:47:41.800028 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 8921
I20260806 11:47:41.800179 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:47:41.800725 27315 external_mini_cluster.cc:1428] Setting key 8b0c60564e655bc8b745ae261aa21de3
Aug 06 11:47:41 dist-test-slave-7z32 krb5kdc[8595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016861, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:47:41.819185 8706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:41.794204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:46193 (local address 127.26.172.254:39007)
0806 11:47:41.794438 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:41.794444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:41.799889 (+ 5445us) server_negotiation.cc:407] Connection header received
0806 11:47:41.802488 (+ 2599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:41.802493 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:41.802580 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:41.802710 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:41.805336 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:41.806237 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:41.808879 (+ 2642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:41.809136 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:41.809266 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:41.812961 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:41.812967 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:41.812973 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:41.813034 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:41.816208 (+ 3174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:41.816901 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:41.816904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:41.816906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:41.817008 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:41.817545 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:41.817549 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:41.817551 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:41.817845 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:41.817955 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:41.818766 (+ 811us) server_negotiation.cc:299] Negotiation successful
0806 11:47:41.818982 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 11:47:41.820314 9101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:41.794955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:39007 (local address 127.26.172.194:46193)
0806 11:47:41.799500 (+ 4545us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:41.799622 (+ 122us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:41.802085 (+ 2463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:41.803082 (+ 997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:41.803097 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:41.803882 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:41.805017 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:41.805056 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:41.806547 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:41.806552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:41.808686 (+ 2134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:41.808710 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:41.809347 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:41.809352 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:41.809638 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:41.810552 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:41.810581 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:41.812703 (+ 2122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:41.816368 (+ 3665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:41.816377 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:41.816401 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:41.816774 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:41.817113 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:41.817117 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:41.817119 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:41.817361 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:41.817954 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:41.817963 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:41.818393 (+ 430us) client_negotiation.cc:769] Sending connection context
0806 11:47:41.818682 (+ 289us) client_negotiation.cc:240] Negotiation successful
0806 11:47:41.819129 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4119,"thread_start_us":1994,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:47:41.822472 9099 heartbeater.cc:347] Connected to a master server at 127.26.172.254:39007
I20260806 11:47:41.822917 9099 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:41.823719 9099 heartbeater.cc:511] Master 127.26.172.254:39007 requested a full tablet report, sending...
I20260806 11:47:41.825506 8651 ts_manager.cc:194] Registered new tserver with Master: b92d87eedc83492493ae441ec72070f3 (127.26.172.194:33505)
I20260806 11:47:41.826176 8651 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:46193
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:47:41.856081 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39007
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:47:42.035262 9104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:47:42.035746 9104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:47:42.035807 9104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:47:42.041905 9104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:47:42.042038 9104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:47:42.042117 9104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:47:42.049397 9104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:47:42.051124 9104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:47:42.052646 9104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:47:42.067411 9113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:42.067377 9110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:47:42.067391 9111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:47:42.067896 9104 server_base.cc:1034] running on GCE node
I20260806 11:47:42.068722 9104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:47:42.069651 9104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:47:42.071189 9104 hybrid_clock.cc:648] HybridClock initialized: now 1786016862071143 us; error 68 us; skew 500 ppm
Aug 06 11:47:42 dist-test-slave-7z32 krb5kdc[8595](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:47:42.075300 9104 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:47:42.076591 9104 webserver.cc:460] Webserver started at http://127.26.172.195:45165/ using document root <none> and password file <none>
I20260806 11:47:42.077380 9104 fs_manager.cc:359] Metadata directory not provided
I20260806 11:47:42.077466 9104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:47:42.077759 9104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:47:42.080837 9104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "3a019c0ece3b416fb666221898b60247"
format_stamp: "Formatted at 2026-08-06 11:47:42 on dist-test-slave-7z32"
server_key: "3aba9122f522e85c9aa9fc5f621db99e"
server_key_iv: "898226bc71e386b5c69d2e7a2e20ecd1"
server_key_version: "encryptionkey@0"
I20260806 11:47:42.081571 9104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "3a019c0ece3b416fb666221898b60247"
format_stamp: "Formatted at 2026-08-06 11:47:42 on dist-test-slave-7z32"
server_key: "3aba9122f522e85c9aa9fc5f621db99e"
server_key_iv: "898226bc71e386b5c69d2e7a2e20ecd1"
server_key_version: "encryptionkey@0"
I20260806 11:47:42.087626 9104 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260806 11:47:42.092223 9128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:42.094357 9104 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:47:42.094683 9104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "3a019c0ece3b416fb666221898b60247"
format_stamp: "Formatted at 2026-08-06 11:47:42 on dist-test-slave-7z32"
server_key: "3aba9122f522e85c9aa9fc5f621db99e"
server_key_iv: "898226bc71e386b5c69d2e7a2e20ecd1"
server_key_version: "encryptionkey@0"
I20260806 11:47:42.094969 9104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:47:42.115857 9104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:47:42.121830 9104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:47:42.122153 9104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:47:42.123106 9104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:47:42.124377 9104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:47:42.124469 9104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:42.124550 9104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:47:42.124606 9104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:47:42.139523 9104 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:34643
I20260806 11:47:42.139585 9281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:34643 every 8 connection(s)
I20260806 11:47:42.141367 9104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:47:42.142089 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 9104
I20260806 11:47:42.142263 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:47:42.142639 27315 external_mini_cluster.cc:1428] Setting key 1090bb08df08c276b083d675483793b4
Aug 06 11:47:42 dist-test-slave-7z32 krb5kdc[8595](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016862, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:47:42.165452 8706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.144482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:58381 (local address 127.26.172.254:39007)
0806 11:47:42.144708 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:42.144716 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:42.146373 (+ 1657us) server_negotiation.cc:407] Connection header received
0806 11:47:42.148364 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:42.148369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:42.148453 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:42.148549 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:42.150164 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.150799 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.152627 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.153003 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.153288 (+ 285us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.158248 (+ 4960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:42.158253 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:42.158267 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:42.158313 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:42.160987 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:42.162085 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:42.162089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:42.162090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:42.162240 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:42.163547 (+ 1307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:42.163551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:42.163552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:42.163818 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:42.163960 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:42.165101 (+ 1141us) server_negotiation.cc:299] Negotiation successful
0806 11:47:42.165265 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 11:47:42.166718 9286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.145206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:39007 (local address 127.26.172.195:58381)
0806 11:47:42.146160 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:42.146239 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:42.148052 (+ 1813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:42.148787 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:42.148798 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:42.149291 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:47:42.149967 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.149986 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.151123 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.151128 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.152420 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.152436 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.153364 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.153369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.153740 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.155187 (+ 1447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:47:42.155210 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:47:42.157896 (+ 2686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:47:42.161260 (+ 3364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:42.161272 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:42.161300 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:42.161848 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:42.162526 (+ 678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:47:42.162531 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:47:42.162533 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:47:42.163182 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:47:42.163992 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:47:42.164001 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:47:42.164672 (+ 671us) client_negotiation.cc:769] Sending connection context
0806 11:47:42.164938 (+ 266us) client_negotiation.cc:240] Negotiation successful
0806 11:47:42.165407 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":218,"threads_started":1}
I20260806 11:47:42.168799 9282 heartbeater.cc:347] Connected to a master server at 127.26.172.254:39007
I20260806 11:47:42.169212 9282 heartbeater.cc:464] Registering TS with master...
I20260806 11:47:42.170038 9282 heartbeater.cc:511] Master 127.26.172.254:39007 requested a full tablet report, sending...
I20260806 11:47:42.171977 8647 ts_manager.cc:194] Registered new tserver with Master: 3a019c0ece3b416fb666221898b60247 (127.26.172.195:34643)
I20260806 11:47:42.172857 8647 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:58381
I20260806 11:47:42.173223 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:47:42.188086 8706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.176139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35582 (local address 127.26.172.254:39007)
0806 11:47:42.176387 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:42.176394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:42.176756 (+ 362us) server_negotiation.cc:407] Connection header received
0806 11:47:42.176971 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:42.176974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:42.177032 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:42.177137 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:47:42.178335 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.179358 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.180662 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.180909 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.181042 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.183591 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:47:42.183597 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:47:42.183599 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:47:42.183648 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:47:42.185642 (+ 1994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:42.186300 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:42.186309 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:42.186311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:42.186411 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:47:42.186866 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:47:42.186870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:47:42.186872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:47:42.187219 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:47:42.187395 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:42.187684 (+ 289us) server_negotiation.cc:299] Negotiation successful
0806 11:47:42.187850 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 11:47:42.193624 8647 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35582:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:47:42.197939 8647 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:47:42.220563 9309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.213275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:33505 (local address 127.0.0.1:41360)
0806 11:47:42.213689 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:42.213707 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:42.213826 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:42.214926 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:42.214931 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:42.214956 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:42.215048 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.215061 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.216645 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.216648 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.218191 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.218203 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.219736 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.219740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.219916 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.219986 (+ 70us) client_negotiation.cc:769] Sending connection context
0806 11:47:42.220126 (+ 140us) client_negotiation.cc:240] Negotiation successful
0806 11:47:42.220341 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":198,"thread_start_us":117,"threads_started":1}
I20260806 11:47:42.221160 9305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.212153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:33809 (local address 127.0.0.1:40340)
0806 11:47:42.212811 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:42.212876 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:42.213042 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:42.214428 (+ 1386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:42.214431 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:42.214444 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:42.214776 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.214790 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.216643 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.216648 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.218742 (+ 2094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.218759 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.220461 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.220465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.220601 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.220640 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 11:47:42.220699 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 11:47:42.220906 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":440,"thread_start_us":175,"threads_started":1}
I20260806 11:47:42.221191 9307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.212384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:34643 (local address 127.0.0.1:52894)
0806 11:47:42.213287 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:42.213300 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:42.213392 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:42.214353 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:42.214363 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:42.214411 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:42.214716 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.214726 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.216644 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.216649 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.218737 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.218759 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.220702 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.220706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.220817 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.220844 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 11:47:42.220927 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 11:47:42.221030 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"mutex_wait_us":304,"thread_start_us":177,"threads_started":1}
I20260806 11:47:42.221602 9308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.213024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52894 (local address 127.26.172.195:34643)
0806 11:47:42.213619 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:42.213636 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:42.213668 (+ 32us) server_negotiation.cc:407] Connection header received
0806 11:47:42.213785 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:42.213793 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:42.214111 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:42.214328 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:42.215004 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.216453 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.218980 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.220273 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.220423 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.220600 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:42.221287 (+ 687us) server_negotiation.cc:299] Negotiation successful
0806 11:47:42.221423 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":200,"threads_started":1}
I20260806 11:47:42.221915 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.213801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41360 (local address 127.26.172.194:33505)
0806 11:47:42.214343 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:42.214363 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:42.214387 (+ 24us) server_negotiation.cc:407] Connection header received
0806 11:47:42.214482 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:42.214487 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:42.214710 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:42.215190 (+ 480us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:42.215353 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.216461 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.218395 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.219455 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.221325 (+ 1870us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.221512 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:42.221566 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 11:47:42.221723 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":251,"threads_started":1}
I20260806 11:47:42.222460 9306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.212333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40340 (local address 127.26.172.193:33809)
0806 11:47:42.213723 (+ 1390us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:42.213732 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:42.213760 (+ 28us) server_negotiation.cc:407] Connection header received
0806 11:47:42.213854 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:42.213860 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:42.214242 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:42.214676 (+ 434us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:42.215026 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.216446 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.219111 (+ 2665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.220292 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.221823 (+ 1531us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.222078 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:42.222161 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 11:47:42.222287 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1247,"thread_start_us":149,"threads_started":1}
I20260806 11:47:42.226251 9196 tablet_service.cc:1467] Processing CreateTablet for tablet b0f468b50a994e928f114d02f3d7ca01 (DEFAULT_TABLE table=test-table [id=b0a2fdbcfeda4e9394fb7d33671c34c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:42.226251 9003 tablet_service.cc:1467] Processing CreateTablet for tablet b0f468b50a994e928f114d02f3d7ca01 (DEFAULT_TABLE table=test-table [id=b0a2fdbcfeda4e9394fb7d33671c34c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:42.228286 9003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0f468b50a994e928f114d02f3d7ca01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:42.228293 9196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0f468b50a994e928f114d02f3d7ca01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:42.230422 8826 tablet_service.cc:1467] Processing CreateTablet for tablet b0f468b50a994e928f114d02f3d7ca01 (DEFAULT_TABLE table=test-table [id=b0a2fdbcfeda4e9394fb7d33671c34c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:47:42.232242 8826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0f468b50a994e928f114d02f3d7ca01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:47:42.239867 9311 tablet_bootstrap.cc:492] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: Bootstrap starting.
I20260806 11:47:42.240957 9312 tablet_bootstrap.cc:492] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: Bootstrap starting.
I20260806 11:47:42.242096 9313 tablet_bootstrap.cc:492] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320: Bootstrap starting.
I20260806 11:47:42.244016 9311 tablet_bootstrap.cc:654] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:42.244906 9313 tablet_bootstrap.cc:654] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:42.245088 9312 tablet_bootstrap.cc:654] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: Neither blocks nor log segments found. Creating new log.
I20260806 11:47:42.245941 9311 log.cc:824] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:42.246122 9313 log.cc:824] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:42.246122 9312 log.cc:824] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: Log is configured to *not* fsync() on all Append() calls
I20260806 11:47:42.249141 9312 tablet_bootstrap.cc:492] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: No bootstrap required, opened a new log
I20260806 11:47:42.249305 9311 tablet_bootstrap.cc:492] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: No bootstrap required, opened a new log
I20260806 11:47:42.249450 9312 ts_tablet_manager.cc:1397] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 11:47:42.249643 9311 ts_tablet_manager.cc:1397] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260806 11:47:42.251466 9313 tablet_bootstrap.cc:492] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320: No bootstrap required, opened a new log
I20260806 11:47:42.251744 9313 ts_tablet_manager.cc:1397] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260806 11:47:42.254593 9311 raft_consensus.cc:348] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.254766 9312 raft_consensus.cc:348] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.255116 9311 raft_consensus.cc:374] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:42.255201 9311 raft_consensus.cc:729] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b92d87eedc83492493ae441ec72070f3, State: Initialized, Role: FOLLOWER
I20260806 11:47:42.255262 9312 raft_consensus.cc:374] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:42.255393 9312 raft_consensus.cc:729] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a019c0ece3b416fb666221898b60247, State: Initialized, Role: FOLLOWER
I20260806 11:47:42.255978 9311 consensus_queue.cc:260] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.256043 9312 consensus_queue.cc:260] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.257043 9099 heartbeater.cc:503] Master 127.26.172.254:39007 was elected leader, sending a full tablet report...
I20260806 11:47:42.257583 9311 ts_tablet_manager.cc:1428] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260806 11:47:42.258244 9312 ts_tablet_manager.cc:1428] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260806 11:47:42.258039 9313 raft_consensus.cc:348] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.258486 9313 raft_consensus.cc:374] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:47:42.258481 9282 heartbeater.cc:503] Master 127.26.172.254:39007 was elected leader, sending a full tablet report...
I20260806 11:47:42.258590 9313 raft_consensus.cc:729] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d617ad35edfe4b43a90155e075783320, State: Initialized, Role: FOLLOWER
I20260806 11:47:42.259225 9313 consensus_queue.cc:260] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.260255 8915 heartbeater.cc:503] Master 127.26.172.254:39007 was elected leader, sending a full tablet report...
I20260806 11:47:42.260569 9313 ts_tablet_manager.cc:1428] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260806 11:47:42.268133 9321 raft_consensus.cc:482] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:47:42.268419 9321 raft_consensus.cc:504] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.270125 9321 leader_election.cc:288] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d617ad35edfe4b43a90155e075783320 (127.26.172.193:33809), 3a019c0ece3b416fb666221898b60247 (127.26.172.195:34643)
I20260806 11:47:42.274040 9322 raft_consensus.cc:482] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:47:42.274456 9322 raft_consensus.cc:504] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.276913 9322 leader_election.cc:288] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d617ad35edfe4b43a90155e075783320 (127.26.172.193:33809), b92d87eedc83492493ae441ec72070f3 (127.26.172.194:33505)
I20260806 11:47:42.277225 9306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.270733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:33609 (local address 127.26.172.193:33809)
0806 11:47:42.270953 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:42.270960 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:42.271543 (+ 583us) server_negotiation.cc:407] Connection header received
0806 11:47:42.271633 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:42.271638 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:42.271705 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:42.271789 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:42.272247 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.272989 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.275114 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.275803 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.275984 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.276054 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:42.276660 (+ 606us) server_negotiation.cc:299] Negotiation successful
0806 11:47:42.276913 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260806 11:47:42.278744 9327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.270531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:33809 (local address 127.26.172.194:33609)
0806 11:47:42.271404 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:42.271417 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:42.271540 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:42.271879 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:42.271882 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:42.271906 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:42.272066 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.272074 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.273141 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.273144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.274877 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.274896 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.276157 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.276161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.276280 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.276312 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 11:47:42.276453 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 11:47:42.276684 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"mutex_wait_us":533,"thread_start_us":178,"threads_started":1}
I20260806 11:47:42.278761 9101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.270531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:34643 (local address 127.26.172.194:54519)
0806 11:47:42.270673 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:42.270690 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:42.270813 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:42.271349 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:42.271354 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:42.271382 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:42.271567 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.271578 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.272874 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.272878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.274325 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.274343 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.276161 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.276166 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.276315 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.276344 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 11:47:42.276443 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 11:47:42.276573 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":5}
I20260806 11:47:42.280256 8851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f468b50a994e928f114d02f3d7ca01" candidate_uuid: "b92d87eedc83492493ae441ec72070f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d617ad35edfe4b43a90155e075783320" is_pre_election: true
I20260806 11:47:42.280758 8851 raft_consensus.cc:2454] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b92d87eedc83492493ae441ec72070f3 in term 0.
I20260806 11:47:42.279546 9308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.270734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:54519 (local address 127.26.172.195:34643)
0806 11:47:42.270979 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:42.270984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:42.271003 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:47:42.271096 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:42.271099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:42.271169 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:42.271312 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:42.271847 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.272626 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.274502 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.275399 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.275546 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.275601 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:42.277876 (+ 2275us) server_negotiation.cc:299] Negotiation successful
0806 11:47:42.278007 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260806 11:47:42.281548 8942 leader_election.cc:302] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b92d87eedc83492493ae441ec72070f3, d617ad35edfe4b43a90155e075783320; no voters:
I20260806 11:47:42.281881 9225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f468b50a994e928f114d02f3d7ca01" candidate_uuid: "b92d87eedc83492493ae441ec72070f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a019c0ece3b416fb666221898b60247" is_pre_election: true
I20260806 11:47:42.281998 9321 raft_consensus.cc:2781] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:47:42.282091 9321 raft_consensus.cc:482] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:47:42.282131 9321 raft_consensus.cc:3037] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:42.282217 9225 raft_consensus.cc:2454] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b92d87eedc83492493ae441ec72070f3 in term 0.
I20260806 11:47:42.284025 9286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.277159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:33809 (local address 127.26.172.195:52131)
0806 11:47:42.277332 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:42.277352 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:42.277471 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:42.279483 (+ 2012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:42.279488 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:42.279528 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:42.279706 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.279715 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.280786 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.280792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.282374 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.282395 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.283428 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.283432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.283581 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.283617 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 11:47:42.283728 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 11:47:42.283860 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260806 11:47:42.284191 9306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.277577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:52131 (local address 127.26.172.193:33809)
0806 11:47:42.278870 (+ 1293us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:42.278876 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:42.278896 (+ 20us) server_negotiation.cc:407] Connection header received
0806 11:47:42.278965 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:42.278970 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:42.279268 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:42.279375 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:42.279899 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.280605 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.282607 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.283257 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.283418 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.283510 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:42.283786 (+ 276us) server_negotiation.cc:299] Negotiation successful
0806 11:47:42.283909 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":980}
I20260806 11:47:42.284099 9321 raft_consensus.cc:504] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.284765 8851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f468b50a994e928f114d02f3d7ca01" candidate_uuid: "3a019c0ece3b416fb666221898b60247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d617ad35edfe4b43a90155e075783320" is_pre_election: true
I20260806 11:47:42.284879 9321 leader_election.cc:288] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [CANDIDATE]: Term 1 election: Requested vote from peers d617ad35edfe4b43a90155e075783320 (127.26.172.193:33809), 3a019c0ece3b416fb666221898b60247 (127.26.172.195:34643)
I20260806 11:47:42.284965 8851 raft_consensus.cc:2454] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a019c0ece3b416fb666221898b60247 in term 0.
I20260806 11:47:42.285830 9133 leader_election.cc:302] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a019c0ece3b416fb666221898b60247, d617ad35edfe4b43a90155e075783320; no voters:
I20260806 11:47:42.285923 8851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f468b50a994e928f114d02f3d7ca01" candidate_uuid: "b92d87eedc83492493ae441ec72070f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d617ad35edfe4b43a90155e075783320"
I20260806 11:47:42.286131 8851 raft_consensus.cc:3037] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:42.286296 9322 raft_consensus.cc:2781] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:47:42.286412 9322 raft_consensus.cc:482] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:47:42.286464 9322 raft_consensus.cc:3037] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:47:42.286782 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.278418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:43561 (local address 127.26.172.194:33505)
0806 11:47:42.278749 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:42.278754 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:42.281900 (+ 3146us) server_negotiation.cc:407] Connection header received
0806 11:47:42.282149 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:42.282153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:42.282219 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:42.282280 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:47:42.282922 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.283655 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.285036 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.285690 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.285849 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.285924 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:42.286457 (+ 533us) server_negotiation.cc:299] Negotiation successful
0806 11:47:42.286617 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260806 11:47:42.286851 9328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.277523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:33505 (local address 127.26.172.195:43561)
0806 11:47:42.281782 (+ 4259us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:42.281801 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:47:42.281989 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:47:42.282454 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:47:42.282460 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:47:42.282593 (+ 133us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:47:42.282740 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.282747 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.283802 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.283805 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.284872 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:47:42.284884 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.286132 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.286137 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:47:42.286247 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.286282 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 11:47:42.286373 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 11:47:42.286487 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4164,"thread_start_us":203,"threads_started":1}
I20260806 11:47:42.287389 9225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f468b50a994e928f114d02f3d7ca01" candidate_uuid: "b92d87eedc83492493ae441ec72070f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a019c0ece3b416fb666221898b60247"
I20260806 11:47:42.287674 9028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f468b50a994e928f114d02f3d7ca01" candidate_uuid: "3a019c0ece3b416fb666221898b60247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b92d87eedc83492493ae441ec72070f3" is_pre_election: true
I20260806 11:47:42.288069 9028 raft_consensus.cc:2379] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a019c0ece3b416fb666221898b60247 in current term 1: Already voted for candidate b92d87eedc83492493ae441ec72070f3 in this term.
I20260806 11:47:42.289355 9322 raft_consensus.cc:504] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.289685 9225 raft_consensus.cc:2379] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b92d87eedc83492493ae441ec72070f3 in current term 1: Already voted for candidate 3a019c0ece3b416fb666221898b60247 in this term.
I20260806 11:47:42.290081 8851 raft_consensus.cc:2454] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b92d87eedc83492493ae441ec72070f3 in term 1.
I20260806 11:47:42.290762 8851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f468b50a994e928f114d02f3d7ca01" candidate_uuid: "3a019c0ece3b416fb666221898b60247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d617ad35edfe4b43a90155e075783320"
I20260806 11:47:42.290907 8942 leader_election.cc:302] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b92d87eedc83492493ae441ec72070f3, d617ad35edfe4b43a90155e075783320; no voters:
I20260806 11:47:42.291157 8851 raft_consensus.cc:2379] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3a019c0ece3b416fb666221898b60247 in current term 1: Already voted for candidate b92d87eedc83492493ae441ec72070f3 in this term.
I20260806 11:47:42.291152 9321 raft_consensus.cc:2781] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:47:42.291453 9321 raft_consensus.cc:686] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 1 LEADER]: Becoming Leader. State: Replica: b92d87eedc83492493ae441ec72070f3, State: Running, Role: LEADER
I20260806 11:47:42.291761 9322 leader_election.cc:288] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [CANDIDATE]: Term 1 election: Requested vote from peers d617ad35edfe4b43a90155e075783320 (127.26.172.193:33809), b92d87eedc83492493ae441ec72070f3 (127.26.172.194:33505)
I20260806 11:47:42.291923 9321 consensus_queue.cc:237] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } }
I20260806 11:47:42.292241 9028 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0f468b50a994e928f114d02f3d7ca01" candidate_uuid: "3a019c0ece3b416fb666221898b60247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b92d87eedc83492493ae441ec72070f3"
W20260806 11:47:42.292797 9100 tablet.cc:2369] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:47:42.292811 9134 leader_election.cc:302] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a019c0ece3b416fb666221898b60247; no voters: b92d87eedc83492493ae441ec72070f3, d617ad35edfe4b43a90155e075783320
I20260806 11:47:42.293138 9322 raft_consensus.cc:2726] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260806 11:47:42.296895 8651 catalog_manager.cc:5495] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b92d87eedc83492493ae441ec72070f3 (127.26.172.194). New cstate: current_term: 1 leader_uuid: "b92d87eedc83492493ae441ec72070f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b92d87eedc83492493ae441ec72070f3" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33505 } health_report { overall_health: HEALTHY } } }
I20260806 11:47:42.327705 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.322996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41374 (local address 127.26.172.194:33505)
0806 11:47:42.323204 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 11:47:42.323209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:47:42.323228 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:47:42.323409 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:47:42.323412 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:47:42.323495 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:47:42.323616 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:47:42.324047 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.324637 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.325727 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:47:42.325970 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:47:42.326082 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:47:42.326526 (+ 444us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:47:42.327150 (+ 624us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:47:42.327259 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 11:47:42.327414 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 11:47:42.327481 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 11:47:42.337538 9225 raft_consensus.cc:1261] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 1 FOLLOWER]: Refusing update from remote peer b92d87eedc83492493ae441ec72070f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:42.337538 8851 raft_consensus.cc:1261] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 1 FOLLOWER]: Refusing update from remote peer b92d87eedc83492493ae441ec72070f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:47:42.338863 9329 consensus_queue.cc:1035] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d617ad35edfe4b43a90155e075783320" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:42.339164 9321 consensus_queue.cc:1035] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a019c0ece3b416fb666221898b60247" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:47:42.372869 8644 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:42.373196 8644 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:47:42.377183 8644 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3580549c0e3d4568b9dfaeb12860bb92: Sending DeleteTablet for 3 replicas of tablet b0f468b50a994e928f114d02f3d7ca01
I20260806 11:47:42.378613 8826 tablet_service.cc:1514] Processing DeleteTablet for tablet b0f468b50a994e928f114d02f3d7ca01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:42 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:40340
I20260806 11:47:42.379160 9196 tablet_service.cc:1514] Processing DeleteTablet for tablet b0f468b50a994e928f114d02f3d7ca01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:42 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:52894
I20260806 11:47:42.379492 9345 tablet_replica.cc:330] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320: stopping tablet replica
I20260806 11:47:42.379604 9003 tablet_service.cc:1514] Processing DeleteTablet for tablet b0f468b50a994e928f114d02f3d7ca01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:47:42 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:41360
I20260806 11:47:42.379792 9346 tablet_replica.cc:330] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: stopping tablet replica
I20260806 11:47:42.380192 9345 raft_consensus.cc:2229] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:42.380249 9346 raft_consensus.cc:2229] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:47:42.380666 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 8743
I20260806 11:47:42.380796 9345 raft_consensus.cc:2258] T b0f468b50a994e928f114d02f3d7ca01 P d617ad35edfe4b43a90155e075783320 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:42.386319 9346 raft_consensus.cc:2258] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:42.386960 9348 tablet_replica.cc:330] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: stopping tablet replica
I20260806 11:47:42.387460 9348 raft_consensus.cc:2229] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:47:42.388029 9348 raft_consensus.cc:2258] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:47:42.389788 9346 ts_tablet_manager.cc:1905] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:42.391762 9348 ts_tablet_manager.cc:1905] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:47:42.393998 9346 ts_tablet_manager.cc:1918] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:42.394210 9346 log.cc:1196] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/b0f468b50a994e928f114d02f3d7ca01
I20260806 11:47:42.394748 9346 ts_tablet_manager.cc:1939] T b0f468b50a994e928f114d02f3d7ca01 P 3a019c0ece3b416fb666221898b60247: Deleting consensus metadata
I20260806 11:47:42.396793 8634 catalog_manager.cc:4841] TS 3a019c0ece3b416fb666221898b60247 (127.26.172.195:34643): tablet b0f468b50a994e928f114d02f3d7ca01 (table test-table [id=b0a2fdbcfeda4e9394fb7d33671c34c6]) successfully deleted
I20260806 11:47:42.397604 9348 ts_tablet_manager.cc:1918] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:47:42.397854 9348 log.cc:1196] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/b0f468b50a994e928f114d02f3d7ca01
I20260806 11:47:42.398370 9348 ts_tablet_manager.cc:1939] T b0f468b50a994e928f114d02f3d7ca01 P b92d87eedc83492493ae441ec72070f3: Deleting consensus metadata
I20260806 11:47:42.400638 8634 catalog_manager.cc:4841] TS b92d87eedc83492493ae441ec72070f3 (127.26.172.194:33505): tablet b0f468b50a994e928f114d02f3d7ca01 (table test-table [id=b0a2fdbcfeda4e9394fb7d33671c34c6]) successfully deleted
W20260806 11:47:42.401615 8633 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:33809 (error 108)
I20260806 11:47:42.401986 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 8921
I20260806 11:47:42.409425 9307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:47:42.408980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:33809 (local address 127.0.0.1:40350)
0806 11:47:42.409167 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 11:47:42.409285 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:33809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260806 11:47:42.409914 8633 catalog_manager.cc:4584] TS d617ad35edfe4b43a90155e075783320 (127.26.172.193:33809): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b0f468b50a994e928f114d02f3d7ca01: Network error: Client connection negotiation failed: client connection to 127.26.172.193:33809: connect: Connection refused (error 111)
I20260806 11:47:42.428874 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 9104
I20260806 11:47:42.452258 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 8612
2026-08-06T11:47:42Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (3326 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:47:42 dist-test-slave-7z32 krb5kdc[9353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:47:42 dist-test-slave-7z32 krb5kdc[9353](info): set up 2 sockets
Aug 06 11:47:42 dist-test-slave-7z32 krb5kdc[9353](info): commencing operation
krb5kdc: starting...
W20260806 11:47:43.820533 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.332s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:47:43 dist-test-slave-7z32 krb5kdc[9353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:47:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:47:43Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.172.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.172.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/rangeradmin_127.26.172.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/rangeradmin_127.26.172.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.172.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.172.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/rangerlookup_127.26.172.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/rangerlookup_127.26.172.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.172.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.172.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/HTTP_127.26.172.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/HTTP_127.26.172.212@KRBTEST.COM.keytab.
I20260806 11:47:44.071321 27315 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJj2CNI/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/postgres -l logfile start
2026-08-06 11:47:48.131 UTC [9399] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 11:47:48.131 UTC [9399] LOG: listening on IPv4 address "127.26.172.212", port 48369
2026-08-06 11:47:48.139 UTC [9399] LOG: listening on Unix socket "/tmp/.s.PGSQL.48369"
2026-08-06 11:47:48.176 UTC [9403] LOG: database system was shut down at 2026-08-06 11:47:45 UTC
2026-08-06 11:47:48.184 UTC [9399] LOG: database system is ready to accept connections
I20260806 11:47:49.525835 27315 mini_postgres.cc:96] Postgres bound to 48369
2026-08-06 11:47:49.536 UTC [9413] FATAL: database "slave" does not exist
127.26.172.212:48369 - accepting connections
I20260806 11:47:49.538450 27315 mini_ranger.cc:161] Starting Ranger...
I20260806 11:47:49.562637 27315 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 11:47:50.641599 27315 mini_ranger.cc:87] Created ranger Postgres database
I20260806 11:47:50.641714 27315 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-admin
2026-08-06 11:47:51,058 [I] DB FLAVOR :POSTGRES
2026-08-06 11:47:51,059 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 11:47:51,059 [I] Checking connection..
2026-08-06 11:47:51,059 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 11:47:51,446 [I] Checking connection passed.
2026-08-06 11:47:51,447 [I] --------- Verifying version history table ---------
2026-08-06 11:47:51,447 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 11:47:51,775 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 11:47:51,776 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 11:47:52,191 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 11:47:52,191 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 11:47:52,192 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 11:47:52.500 UTC [9495] WARNING: there is no transaction in progress
2026-08-06 11:47:52,512 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 11:47:52,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 11:47:52,831 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 11:47:52,831 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 11:47:52,831 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 11:47:53,144 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 11:47:53,498 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7z32.c.gcp-upstream.internal','N') ;"
2026-08-06 11:47:53,827 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 11:47:54,179 [I] Table x_portal_user does not exist in database ranger
2026-08-06 11:47:54,179 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 11:47:54,524 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 11:47:54,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 11:47:54,859 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 11:47:55,206 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 11:47:55,206 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 11:47:56.697 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:56.721 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:56.746 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:56.771 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:56.799 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:56.829 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:56.914 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:56.925 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:56.951 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:56.968 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:56.988 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:57.017 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:57.035 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:57.047 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:57.061 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:57.074 UTC [9644] WARNING: there is no transaction in progress
2026-08-06 11:47:58,340 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 11:47:58,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 11:47:58,695 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 11:47:58,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 11:47:59,042 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 11:47:59,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 11:47:59,424 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 11:47:59,424 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 11:47:59,751 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 11:48:00,106 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7z32.c.gcp-upstream.internal';"
2026-08-06 11:48:00,424 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 11:48:00,425 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 11:48:00,776 [I] DB_PATCHES have already been applied
I20260806 11:48:00.783452 27315 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJj2CNI/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 11:48:00.783588 27315 mini_ranger.cc:193] Using host: 127.26.172.212
I20260806 11:48:00.791625 27315 mini_ranger.cc:227] Ranger admin URL: http://127.26.172.212:34347
Aug 06, 2026 11:48:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 11:48:01 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 11:48:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 11:48:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 11:48:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 11:48:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 11:48:02 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 11:48:02.350813 27315 mini_ranger.cc:160] Time spent starting Ranger: real 12.812s user 0.011s sys 0.011s
Aug 06, 2026 11:48:29 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 11:48:29 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Aug 06, 2026 11:48:29 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 11:48:29 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 11:48:31 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 11:48:31.810555 27315 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.172.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.172.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/rangerkms_127.26.172.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/rangerkms_127.26.172.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.172.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.172.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.172.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/HTTP_127.26.172.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.172.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/HTTP_127.26.172.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 11:48:31 dist-test-slave-7z32 krb5kdc[9353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016911, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 11:48:31.944669 27315 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 11:48:31.962323 27315 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 11:48:32.969942 27315 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 11:48:32.970062 27315 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-kms
I20260806 11:48:32.970189 27315 mini_ranger_kms.cc:227] Using postgres at 127.26.172.212:48369
2026-08-06 11:48:33,939 [I] DB FLAVOR :POSTGRES
2026-08-06 11:48:33,940 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 11:48:33,940 [I] Checking connection
2026-08-06 11:48:33,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 11:48:34,291 [I] connection success
2026-08-06 11:48:34,291 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 11:48:34,291 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 11:48:34,291 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 11:48:34,582 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 11:48:34,582 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 11:48:34,582 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 11:48:34,582 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:48369/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 11:48:34,949 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 11:48:35.703835 27315 mini_ranger_kms.cc:310] Created kms service
I20260806 11:48:35.955325 27315 mini_ranger_kms.cc:326] Created kudu user
I20260806 11:48:36.015084 27315 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 11:48:36 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016911, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:48:36.537788 27315 mini_ranger_kms.cc:384] Added ranger policy
I20260806 11:48:36.538074 27315 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 11:48:36.538125 27315 mini_ranger_kms.cc:240] Using host: 127.26.172.212
I20260806 11:48:36.545261 27315 mini_ranger_kms.cc:276] Ranger KMS PID: 9895
I20260806 11:48:36.545627 27315 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.172.212:48129
Aug 06, 2026 11:48:37 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 11:48:37 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 11:48:37 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 11:48:37 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 11:48:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 11:48:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 11:48:39 dist-test-slave-7z32 krb5kdc[9353](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786016919, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.172.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:48:39.571524 27315 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 7.627s user 0.003s sys 0.563s
I20260806 11:48:39.571732 27315 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 11:48:39.571877 27315 mini_ranger_kms.cc:401] 127.26.172.212:48129/kms/v1/keys
Aug 06 11:48:40 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016919, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.172.212@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
Aug 06 11:48:40 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016919, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.172.212@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
Aug 06 11:48:44 dist-test-slave-7z32 krb5kdc[9353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:48:44.112784 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:44935
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:34857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:44935
--ranger_config_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:48129/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:48:44.330680 9970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:48:44.331275 9970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:48:44.331389 9970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:48:44.336846 9970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:48:44.337052 9970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:48:44.337121 9970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:48:44.337167 9970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:48:44.337203 9970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:48:44.345937 9970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:34857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.172.212:48129/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:44935
--ranger_config_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:44935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:48:44.347864 9970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:48:44.349996 9970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:48:44.365160 9979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:48:44.365264 9978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:48:44.365578 9970 server_base.cc:1034] running on GCE node
W20260806 11:48:44.365798 9983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:48:44.366683 9970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:48:44.368489 9970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:48:44.369735 9970 hybrid_clock.cc:648] HybridClock initialized: now 1786016924369695 us; error 62 us; skew 500 ppm
Aug 06 11:48:44 dist-test-slave-7z32 krb5kdc[9353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016924, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:48:44.374068 9970 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:48:44.375648 9970 webserver.cc:460] Webserver started at http://127.26.172.254:36111/ using document root <none> and password file <none>
I20260806 11:48:44.376519 9970 fs_manager.cc:359] Metadata directory not provided
I20260806 11:48:44.376614 9970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:48:44.376919 9970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 11:48:44 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016924, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:48:44.455608 9970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "f949f61706ad4aadb464bb3522580fc9"
format_stamp: "Formatted at 2026-08-06 11:48:44 on dist-test-slave-7z32"
server_key: "88256d6d396adbc8e243d5ca48d81b7d"
server_key_iv: "3e80bd554d8d47a3e2aa9d550d86e8ec"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:44.456517 9970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "f949f61706ad4aadb464bb3522580fc9"
format_stamp: "Formatted at 2026-08-06 11:48:44 on dist-test-slave-7z32"
server_key: "88256d6d396adbc8e243d5ca48d81b7d"
server_key_iv: "3e80bd554d8d47a3e2aa9d550d86e8ec"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:44.462702 9970 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 11:48:44.485220 9992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:48:44.487353 9970 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:48:44.487612 9970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "f949f61706ad4aadb464bb3522580fc9"
format_stamp: "Formatted at 2026-08-06 11:48:44 on dist-test-slave-7z32"
server_key: "88256d6d396adbc8e243d5ca48d81b7d"
server_key_iv: "3e80bd554d8d47a3e2aa9d550d86e8ec"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:44.487800 9970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:48:44.508670 9970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:48:44.513242 9970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:48:44.513562 9970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:48:44.529359 9970 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:44935
I20260806 11:48:44.529506 10067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:44935 every 8 connection(s)
I20260806 11:48:44.530987 9970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:48:44.535171 10069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:48:44.540278 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 9970
I20260806 11:48:44.540447 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:48:44.540783 27315 external_mini_cluster.cc:1428] Setting key a20f47471340f1e2c869ffe062f23157
I20260806 11:48:44.544181 10069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9: Bootstrap starting.
I20260806 11:48:44.548544 10069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9: Neither blocks nor log segments found. Creating new log.
I20260806 11:48:44.550004 10069 log.cc:824] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9: Log is configured to *not* fsync() on all Append() calls
I20260806 11:48:44.553655 10069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9: No bootstrap required, opened a new log
Aug 06 11:48:44 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:48:44.559242 10069 raft_consensus.cc:348] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f949f61706ad4aadb464bb3522580fc9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44935 } }
I20260806 11:48:44.559705 10069 raft_consensus.cc:374] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:48:44.559823 10069 raft_consensus.cc:729] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f949f61706ad4aadb464bb3522580fc9, State: Initialized, Role: FOLLOWER
I20260806 11:48:44.560467 10069 consensus_queue.cc:260] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f949f61706ad4aadb464bb3522580fc9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44935 } }
I20260806 11:48:44.560708 10069 raft_consensus.cc:388] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:48:44.560808 10069 raft_consensus.cc:482] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:48:44.560933 10069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:48:44.562703 10069 raft_consensus.cc:504] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f949f61706ad4aadb464bb3522580fc9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44935 } }
I20260806 11:48:44.563248 10072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:44.543068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60272 (local address 127.26.172.254:44935)
0806 11:48:44.543796 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:44.543833 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:44.543889 (+ 56us) server_negotiation.cc:407] Connection header received
0806 11:48:44.545166 (+ 1277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:44.545198 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:44.545748 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:44.546355 (+ 607us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:48:44.547611 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:44.549509 (+ 1898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:44.550998 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:44.551753 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:44.551992 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:44.555373 (+ 3381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:48:44.555382 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:48:44.555407 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:48:44.555449 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:48:44.558609 (+ 3160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:48:44.559368 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:48:44.559375 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:48:44.559382 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:48:44.559511 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:48:44.559856 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:48:44.559862 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:48:44.559864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:48:44.560702 (+ 838us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:48:44.560985 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:44.561540 (+ 555us) server_negotiation.cc:299] Negotiation successful
0806 11:48:44.561970 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":195,"threads_started":1}
I20260806 11:48:44.563247 10069 leader_election.cc:302] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f949f61706ad4aadb464bb3522580fc9; no voters:
I20260806 11:48:44.563812 10069 leader_election.cc:288] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:48:44.564070 10074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:48:44.564451 10074 raft_consensus.cc:686] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [term 1 LEADER]: Becoming Leader. State: Replica: f949f61706ad4aadb464bb3522580fc9, State: Running, Role: LEADER
I20260806 11:48:44.564965 10074 consensus_queue.cc:237] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f949f61706ad4aadb464bb3522580fc9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44935 } }
I20260806 11:48:44.565636 10069 sys_catalog.cc:564] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:48:44.566893 10074 sys_catalog.cc:455] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f949f61706ad4aadb464bb3522580fc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f949f61706ad4aadb464bb3522580fc9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44935 } } }
I20260806 11:48:44.567185 10074 sys_catalog.cc:458] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [sys.catalog]: This master's current role is: LEADER
I20260806 11:48:44.567596 10074 sys_catalog.cc:455] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f949f61706ad4aadb464bb3522580fc9. Latest consensus state: current_term: 1 leader_uuid: "f949f61706ad4aadb464bb3522580fc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f949f61706ad4aadb464bb3522580fc9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 44935 } } }
I20260806 11:48:44.567724 10074 sys_catalog.cc:458] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9 [sys.catalog]: This master's current role is: LEADER
I20260806 11:48:44.568782 10087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:48:44.573401 10087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:48:44.574191 10069 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 11:48:44.589146 10087 catalog_manager.cc:1347] Generated new cluster ID: 0a6f1ca5dc494b8092f60b9234136ca3
I20260806 11:48:44.589263 10087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:48:44.601379 10087 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:48:44.603163 10087 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:48:44.613423 10087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9: Generated new TSK 0
I20260806 11:48:44.614601 10087 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:48:45.568403 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:48129/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:44935
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:34857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:48:45.775400 10131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:48:45.775936 10131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:48:45.776068 10131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:48:45.781893 10131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:48:45.782133 10131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:48:45.782294 10131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:48:45.789875 10131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:34857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.172.212:48129/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:44935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:48:45.791402 10131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:48:45.792719 10131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:48:45.809504 10140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:48:45.809791 10139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:48:45.809687 10142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:48:45.811537 10131 server_base.cc:1034] running on GCE node
I20260806 11:48:45.812217 10131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:48:45.813138 10131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:48:45.814363 10131 hybrid_clock.cc:648] HybridClock initialized: now 1786016925814310 us; error 67 us; skew 500 ppm
Aug 06 11:48:45 dist-test-slave-7z32 krb5kdc[9353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016925, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:48:45.818600 10131 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:48:45.820044 10131 webserver.cc:460] Webserver started at http://127.26.172.193:43303/ using document root <none> and password file <none>
I20260806 11:48:45.820803 10131 fs_manager.cc:359] Metadata directory not provided
I20260806 11:48:45.820917 10131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:48:45.821218 10131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 11:48:45 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016925, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:48:45.839598 10131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "fb416fa6b4fe46a4a093cd3177f96a62"
format_stamp: "Formatted at 2026-08-06 11:48:45 on dist-test-slave-7z32"
server_key: "bb2c31323a2e561d94de28ef568d3df1"
server_key_iv: "54c7edcdd90ed5f2cbf373708ac631d2"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:45.840724 10131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "fb416fa6b4fe46a4a093cd3177f96a62"
format_stamp: "Formatted at 2026-08-06 11:48:45 on dist-test-slave-7z32"
server_key: "bb2c31323a2e561d94de28ef568d3df1"
server_key_iv: "54c7edcdd90ed5f2cbf373708ac631d2"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:45.847954 10131 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.004s
I20260806 11:48:45.891618 10149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:48:45.896626 10131 fs_manager.cc:725] Time spent opening block manager: real 0.024s user 0.002s sys 0.001s
I20260806 11:48:45.896821 10131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "fb416fa6b4fe46a4a093cd3177f96a62"
format_stamp: "Formatted at 2026-08-06 11:48:45 on dist-test-slave-7z32"
server_key: "bb2c31323a2e561d94de28ef568d3df1"
server_key_iv: "54c7edcdd90ed5f2cbf373708ac631d2"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:45.897022 10131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:48:45.920596 10131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:48:45.926026 10131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:48:45.926344 10131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:48:45.927340 10131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:48:45.928716 10131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:48:45.928836 10131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 11:48:45.928983 10131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:48:45.929064 10131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:48:45.946082 10131 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:34501
I20260806 11:48:45.947546 10131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:48:45.949801 10296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:34501 every 8 connection(s)
I20260806 11:48:45.950479 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 10131
I20260806 11:48:45.950637 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:48:45.951021 27315 external_mini_cluster.cc:1428] Setting key 91061b1810047c37bef402c57ca717db
Aug 06 11:48:45 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016925, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:48:45.978772 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:45.960155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:36961 (local address 127.26.172.254:44935)
0806 11:48:45.961232 (+ 1077us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:45.961239 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:45.961267 (+ 28us) server_negotiation.cc:407] Connection header received
0806 11:48:45.962572 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:45.962576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:45.962651 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:45.962745 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:48:45.964830 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:45.965750 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:45.967751 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:45.968163 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:45.968248 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:45.971965 (+ 3717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:48:45.971972 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:48:45.971977 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:48:45.972015 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:48:45.974615 (+ 2600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:48:45.975536 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:48:45.975541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:48:45.975543 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:48:45.975654 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:48:45.976322 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:48:45.976329 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:48:45.976332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:48:45.976743 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:48:45.976908 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:45.978277 (+ 1369us) server_negotiation.cc:299] Negotiation successful
0806 11:48:45.978517 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":936,"thread_start_us":149,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:48:45.980209 10301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:45.958947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:44935 (local address 127.26.172.193:36961)
0806 11:48:45.960612 (+ 1665us) negotiation.cc:107] Waiting for socket to connect
0806 11:48:45.960721 (+ 109us) client_negotiation.cc:174] Beginning negotiation
0806 11:48:45.962097 (+ 1376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:48:45.963207 (+ 1110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:48:45.963218 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:48:45.963714 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:48:45.964550 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:45.964578 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:45.965936 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:45.965940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:45.967578 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:45.967593 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:45.968551 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:45.968556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:45.968830 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:45.969703 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:48:45.969728 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:48:45.971675 (+ 1947us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:48:45.974875 (+ 3200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:48:45.974883 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:48:45.974910 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:48:45.975382 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:48:45.975775 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:48:45.975777 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:48:45.975781 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:48:45.976048 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:48:45.976933 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:48:45.977199 (+ 266us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:48:45.977734 (+ 535us) client_negotiation.cc:769] Sending connection context
0806 11:48:45.978070 (+ 336us) client_negotiation.cc:240] Negotiation successful
0806 11:48:45.978688 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1245,"thread_start_us":275,"threads_started":1}
I20260806 11:48:45.982936 10297 heartbeater.cc:347] Connected to a master server at 127.26.172.254:44935
I20260806 11:48:45.983309 10297 heartbeater.cc:464] Registering TS with master...
I20260806 11:48:45.984161 10297 heartbeater.cc:511] Master 127.26.172.254:44935 requested a full tablet report, sending...
I20260806 11:48:45.986929 10015 ts_manager.cc:194] Registered new tserver with Master: fb416fa6b4fe46a4a093cd3177f96a62 (127.26.172.193:34501)
I20260806 11:48:45.988780 10015 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:36961
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:48:46.008162 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:48129/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:44935
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:34857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:48:46 dist-test-slave-7z32 krb5kdc[9353](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786016926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 11:48:46.234136 10307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:48:46.234655 10307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:48:46.234735 10307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:48:46.241894 10307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:48:46.242108 10307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:48:46.242245 10307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:48:46.250933 10307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:34857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.172.212:48129/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:44935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:48:46.252593 10307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:48:46.254117 10307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:48:46.270133 10321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:48:46.270684 10324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:48:46.270924 10319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:48:46.271028 10307 server_base.cc:1034] running on GCE node
I20260806 11:48:46.272008 10307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:48:46.273032 10307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:48:46.276417 10307 hybrid_clock.cc:648] HybridClock initialized: now 1786016926276365 us; error 74 us; skew 500 ppm
Aug 06 11:48:46 dist-test-slave-7z32 krb5kdc[9353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:48:46.281915 10307 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:48:46.283797 10307 webserver.cc:460] Webserver started at http://127.26.172.194:39815/ using document root <none> and password file <none>
I20260806 11:48:46.284832 10307 fs_manager.cc:359] Metadata directory not provided
I20260806 11:48:46.284953 10307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:48:46.285279 10307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 11:48:46 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:48:46.309456 10307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "8b9f382d465e4dc9ba91c4a85c8a1304"
format_stamp: "Formatted at 2026-08-06 11:48:46 on dist-test-slave-7z32"
server_key: "0054d40402bdb9031fff4106e943341d"
server_key_iv: "24977f1c45b45825b83101ff7a89c817"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:46.310469 10307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "8b9f382d465e4dc9ba91c4a85c8a1304"
format_stamp: "Formatted at 2026-08-06 11:48:46 on dist-test-slave-7z32"
server_key: "0054d40402bdb9031fff4106e943341d"
server_key_iv: "24977f1c45b45825b83101ff7a89c817"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:46.318078 10307 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.003s
I20260806 11:48:46.341856 10331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:48:46.344164 10307 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260806 11:48:46.344471 10307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "8b9f382d465e4dc9ba91c4a85c8a1304"
format_stamp: "Formatted at 2026-08-06 11:48:46 on dist-test-slave-7z32"
server_key: "0054d40402bdb9031fff4106e943341d"
server_key_iv: "24977f1c45b45825b83101ff7a89c817"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:46.344813 10307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:48:46.370177 10307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:48:46.386960 10307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:48:46.387262 10307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:48:46.388201 10307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:48:46.389909 10307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:48:46.390007 10307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:48:46.390093 10307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:48:46.390147 10307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:48:46.414898 10307 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:35697
I20260806 11:48:46.416945 10307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:48:46.419797 10490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:35697 every 8 connection(s)
I20260806 11:48:46.431257 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 10307
I20260806 11:48:46.431430 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:48:46.431818 27315 external_mini_cluster.cc:1428] Setting key 2a7efe2e2897932935d56b2cc3691e37
Aug 06 11:48:46 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:48:46.456842 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:46.422495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:60411 (local address 127.26.172.254:44935)
0806 11:48:46.422654 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:46.422660 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:46.422683 (+ 23us) server_negotiation.cc:407] Connection header received
0806 11:48:46.424142 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:46.424150 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:46.424266 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:46.424338 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:48:46.427878 (+ 3540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:46.429303 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:46.432073 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:46.432484 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:46.432589 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:46.448087 (+ 15498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:48:46.448096 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:48:46.448103 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:48:46.448154 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:48:46.450611 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:48:46.453842 (+ 3231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:48:46.453851 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:48:46.453856 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:48:46.453988 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:48:46.454618 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:48:46.454625 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:48:46.454630 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:48:46.455033 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:48:46.455142 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:46.456239 (+ 1097us) server_negotiation.cc:299] Negotiation successful
0806 11:48:46.456501 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 11:48:46.464401 10493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:46.421039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:44935 (local address 127.26.172.194:60411)
0806 11:48:46.421908 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0806 11:48:46.421996 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0806 11:48:46.423742 (+ 1746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:48:46.424978 (+ 1236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:48:46.424992 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:48:46.425665 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:48:46.427518 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:46.427560 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:46.429629 (+ 2069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:46.429633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:46.431806 (+ 2173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:46.431825 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:46.433139 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:46.433143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:46.433413 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:46.445383 (+ 11970us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:48:46.445416 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:48:46.447690 (+ 2274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:48:46.452929 (+ 5239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:48:46.452951 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:48:46.452987 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:48:46.453636 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:48:46.454185 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:48:46.454192 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:48:46.454194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:48:46.454477 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:48:46.455231 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:48:46.455243 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:48:46.455770 (+ 527us) client_negotiation.cc:769] Sending connection context
0806 11:48:46.457743 (+ 1973us) client_negotiation.cc:240] Negotiation successful
0806 11:48:46.458473 (+ 730us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":220,"threads_started":1}
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:48:46.471174 10491 heartbeater.cc:347] Connected to a master server at 127.26.172.254:44935
I20260806 11:48:46.471645 10491 heartbeater.cc:464] Registering TS with master...
I20260806 11:48:46.472671 10491 heartbeater.cc:511] Master 127.26.172.254:44935 requested a full tablet report, sending...
I20260806 11:48:46.475270 10015 ts_manager.cc:194] Registered new tserver with Master: 8b9f382d465e4dc9ba91c4a85c8a1304 (127.26.172.194:35697)
I20260806 11:48:46.476790 10015 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:60411
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:48:46.516180 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:48129/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:44935
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:34857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:48:46 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
W20260806 11:48:46.726320 10498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:48:46.726783 10498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:48:46.727486 10498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:48:46.734139 10498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:48:46.734254 10498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:48:46.734349 10498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:48:46.743031 10498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:34857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.172.212:48129/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:44935
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:48:46.744727 10498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:48:46.746158 10498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:48:46.761478 10505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:48:46.762457 10504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:48:46.763274 10498 server_base.cc:1034] running on GCE node
W20260806 11:48:46.763022 10509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:48:46.764564 10498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:48:46.765534 10498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:48:46.768879 10498 hybrid_clock.cc:648] HybridClock initialized: now 1786016926768763 us; error 126 us; skew 500 ppm
Aug 06 11:48:46 dist-test-slave-7z32 krb5kdc[9353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:48:46.776767 10498 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:48:46.779883 10498 webserver.cc:460] Webserver started at http://127.26.172.195:34485/ using document root <none> and password file <none>
I20260806 11:48:46.781118 10498 fs_manager.cc:359] Metadata directory not provided
I20260806 11:48:46.781309 10498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:48:46.781702 10498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 11:48:46 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:48:46.813076 10498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "3a71ae6d375b4489b03bd8e93a809e7a"
format_stamp: "Formatted at 2026-08-06 11:48:46 on dist-test-slave-7z32"
server_key: "d66daec5f4558c9e32c7a9d8d1d1e5d5"
server_key_iv: "d73a85644104b801b0326fa60034c96b"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:46.814776 10498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "3a71ae6d375b4489b03bd8e93a809e7a"
format_stamp: "Formatted at 2026-08-06 11:48:46 on dist-test-slave-7z32"
server_key: "d66daec5f4558c9e32c7a9d8d1d1e5d5"
server_key_iv: "d73a85644104b801b0326fa60034c96b"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:46.830111 10498 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.006s sys 0.000s
I20260806 11:48:46.859745 10517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:48:46.861997 10498 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.004s sys 0.000s
I20260806 11:48:46.862250 10498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "3a71ae6d375b4489b03bd8e93a809e7a"
format_stamp: "Formatted at 2026-08-06 11:48:46 on dist-test-slave-7z32"
server_key: "d66daec5f4558c9e32c7a9d8d1d1e5d5"
server_key_iv: "d73a85644104b801b0326fa60034c96b"
server_key_version: "kuduclusterkey@0"
I20260806 11:48:46.862457 10498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:48:46.893676 10498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:48:46.899148 10498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:48:46.899501 10498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:48:46.900681 10498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:48:46.902419 10498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:48:46.902557 10498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:48:46.902686 10498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:48:46.902773 10498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:48:46.934800 10498 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:42467
I20260806 11:48:46.935093 10662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:42467 every 8 connection(s)
I20260806 11:48:46.936448 10498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:48:46.943054 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 10498
I20260806 11:48:46.943210 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:48:46.943598 27315 external_mini_cluster.cc:1428] Setting key fc4784efde7fa6b418ed83f2fbfbcfff
Aug 06 11:48:46 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:48:46.965526 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:46.940444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:52515 (local address 127.26.172.254:44935)
0806 11:48:46.940684 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:46.940691 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:46.942349 (+ 1658us) server_negotiation.cc:407] Connection header received
0806 11:48:46.944309 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:46.944314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:46.944394 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:46.944461 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:48:46.947422 (+ 2961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:46.948416 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:46.952813 (+ 4397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:46.953263 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:46.953371 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:46.959423 (+ 6052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:48:46.959428 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:48:46.959431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:48:46.959470 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:48:46.961739 (+ 2269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:48:46.962789 (+ 1050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:48:46.962793 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:48:46.962795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:48:46.962958 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:48:46.963587 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:48:46.963591 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:48:46.963593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:48:46.963926 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:48:46.964050 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:46.965099 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0806 11:48:46.965306 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260806 11:48:46.967770 10666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:46.941031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:44935 (local address 127.26.172.195:52515)
0806 11:48:46.942051 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0806 11:48:46.942141 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0806 11:48:46.943895 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:48:46.945101 (+ 1206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:48:46.945113 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:48:46.945844 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:48:46.947183 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:46.947212 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:46.948618 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:46.948622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:46.952564 (+ 3942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:46.952597 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:46.953672 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:46.953678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:46.954062 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:46.955227 (+ 1165us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:48:46.955253 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:48:46.959090 (+ 3837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:48:46.961966 (+ 2876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:48:46.961979 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:48:46.962008 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:48:46.962599 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:48:46.963153 (+ 554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:48:46.963157 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:48:46.963160 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:48:46.963429 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:48:46.964115 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:48:46.964126 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:48:46.964677 (+ 551us) client_negotiation.cc:769] Sending connection context
0806 11:48:46.964995 (+ 318us) client_negotiation.cc:240] Negotiation successful
0806 11:48:46.966131 (+ 1136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":421,"threads_started":1}
I20260806 11:48:46.969851 10663 heartbeater.cc:347] Connected to a master server at 127.26.172.254:44935
I20260806 11:48:46.970238 10663 heartbeater.cc:464] Registering TS with master...
I20260806 11:48:46.971182 10663 heartbeater.cc:511] Master 127.26.172.254:44935 requested a full tablet report, sending...
I20260806 11:48:46.972829 10015 ts_manager.cc:194] Registered new tserver with Master: 3a71ae6d375b4489b03bd8e93a809e7a (127.26.172.195:42467)
I20260806 11:48:46.973850 10015 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:52515
I20260806 11:48:46.984184 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:48:46.993008 10297 heartbeater.cc:503] Master 127.26.172.254:44935 was elected leader, sending a full tablet report...
I20260806 11:48:47.001685 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:46.987653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60276 (local address 127.26.172.254:44935)
0806 11:48:46.987806 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:46.987811 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:46.988530 (+ 719us) server_negotiation.cc:407] Connection header received
0806 11:48:46.988709 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:46.988714 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:46.988833 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:46.989018 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:48:46.990277 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:46.991810 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:46.993596 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:46.994090 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:46.994189 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:46.996574 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:48:46.996579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:48:46.996583 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:48:46.996624 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:48:46.998969 (+ 2345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:48:46.999788 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:48:46.999793 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:48:46.999795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:48:46.999924 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:48:47.000361 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:48:47.000364 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:48:47.000366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:48:47.000686 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:48:47.000846 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:47.001296 (+ 450us) server_negotiation.cc:299] Negotiation successful
0806 11:48:47.001473 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 11:48:47.006803 10015 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:48:47.013798 10015 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:48:47.044371 10683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.031414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:42467 (local address 127.0.0.1:39986)
0806 11:48:47.035977 (+ 4563us) negotiation.cc:107] Waiting for socket to connect
0806 11:48:47.035996 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:48:47.036203 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:48:47.037223 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:48:47.037227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:48:47.037248 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:48:47.037385 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:47.037392 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.039473 (+ 2081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.039477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:47.041021 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:47.041046 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.043453 (+ 2407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.043458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:47.043621 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.043670 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 11:48:47.043822 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 11:48:47.044018 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4482,"thread_start_us":346,"threads_started":1}
I20260806 11:48:47.045202 10681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.031444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36758 (local address 127.26.172.194:35697)
0806 11:48:47.034663 (+ 3219us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:47.034672 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:47.034703 (+ 31us) server_negotiation.cc:407] Connection header received
0806 11:48:47.034798 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:47.034805 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:47.035107 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:47.035299 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:48:47.035911 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.038606 (+ 2695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.042365 (+ 3759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.043525 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.043718 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.043931 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:47.044877 (+ 946us) server_negotiation.cc:299] Negotiation successful
0806 11:48:47.045023 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3059,"thread_start_us":247,"threads_started":1}
I20260806 11:48:47.044713 10680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.031268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35697 (local address 127.0.0.1:36758)
0806 11:48:47.033993 (+ 2725us) negotiation.cc:107] Waiting for socket to connect
0806 11:48:47.034067 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 11:48:47.034247 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:48:47.035547 (+ 1300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:48:47.035555 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:48:47.035584 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:48:47.035750 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:47.035757 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.038891 (+ 3134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.038896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:47.042133 (+ 3237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:47.042153 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.044029 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.044033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:47.044159 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.044193 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 11:48:47.044332 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 11:48:47.044463 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2449,"thread_start_us":227,"threads_started":1}
I20260806 11:48:47.046030 10682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.032653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39986 (local address 127.26.172.195:42467)
0806 11:48:47.035699 (+ 3046us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:47.035712 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:47.036329 (+ 617us) server_negotiation.cc:407] Connection header received
0806 11:48:47.036452 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:47.036460 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:47.036758 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:47.037006 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:48:47.037538 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.039297 (+ 1759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.041353 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.042938 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.043126 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.043347 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:47.045645 (+ 2298us) server_negotiation.cc:299] Negotiation successful
0806 11:48:47.045817 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2913,"thread_start_us":291,"threads_started":1}
I20260806 11:48:47.051062 10579 tablet_service.cc:1467] Processing CreateTablet for tablet 58390703a50e472aa0f30e57361ea4f0 (DEFAULT_TABLE table=test-table [id=22cc4b9796d84e7e838cee4c3a5ffb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:48:47.052304 10684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.034489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34108 (local address 127.26.172.193:34501)
0806 11:48:47.035373 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:47.035382 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:47.045699 (+ 10317us) server_negotiation.cc:407] Connection header received
0806 11:48:47.046022 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:47.046033 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:47.046429 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:47.046702 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:48:47.047242 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.048599 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.050127 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.051132 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.051277 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.051457 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:47.051951 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 11:48:47.052108 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751,"thread_start_us":203,"threads_started":1}
I20260806 11:48:47.053350 10579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58390703a50e472aa0f30e57361ea4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:48:47.053330 10680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.033847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:34501 (local address 127.0.0.1:34108)
0806 11:48:47.045542 (+ 11695us) negotiation.cc:107] Waiting for socket to connect
0806 11:48:47.045563 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:48:47.045820 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:48:47.046984 (+ 1164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:48:47.046987 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:48:47.047007 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:48:47.047106 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:47.047111 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.048782 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.048786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:47.049959 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:47.049973 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.051596 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.051599 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:47.051731 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.051764 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 11:48:47.052888 (+ 1124us) client_negotiation.cc:240] Negotiation successful
0806 11:48:47.053026 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11606,"thread_start_us":215,"threads_started":1}
I20260806 11:48:47.051342 10398 tablet_service.cc:1467] Processing CreateTablet for tablet 58390703a50e472aa0f30e57361ea4f0 (DEFAULT_TABLE table=test-table [id=22cc4b9796d84e7e838cee4c3a5ffb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:48:47.054735 10398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58390703a50e472aa0f30e57361ea4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:48:47.058926 10215 tablet_service.cc:1467] Processing CreateTablet for tablet 58390703a50e472aa0f30e57361ea4f0 (DEFAULT_TABLE table=test-table [id=22cc4b9796d84e7e838cee4c3a5ffb73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:48:47.060974 10215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58390703a50e472aa0f30e57361ea4f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:48:47.070783 10687 tablet_bootstrap.cc:492] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: Bootstrap starting.
I20260806 11:48:47.074447 10687 tablet_bootstrap.cc:654] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: Neither blocks nor log segments found. Creating new log.
I20260806 11:48:47.074604 10689 tablet_bootstrap.cc:492] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62: Bootstrap starting.
I20260806 11:48:47.075718 10687 log.cc:824] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: Log is configured to *not* fsync() on all Append() calls
I20260806 11:48:47.076004 10688 tablet_bootstrap.cc:492] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: Bootstrap starting.
I20260806 11:48:47.078197 10689 tablet_bootstrap.cc:654] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62: Neither blocks nor log segments found. Creating new log.
I20260806 11:48:47.079924 10688 tablet_bootstrap.cc:654] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: Neither blocks nor log segments found. Creating new log.
I20260806 11:48:47.080269 10689 log.cc:824] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62: Log is configured to *not* fsync() on all Append() calls
I20260806 11:48:47.081060 10688 log.cc:824] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: Log is configured to *not* fsync() on all Append() calls
I20260806 11:48:47.083735 10689 tablet_bootstrap.cc:492] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62: No bootstrap required, opened a new log
I20260806 11:48:47.083735 10687 tablet_bootstrap.cc:492] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: No bootstrap required, opened a new log
I20260806 11:48:47.084151 10687 ts_tablet_manager.cc:1397] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.005s
I20260806 11:48:47.084147 10689 ts_tablet_manager.cc:1397] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260806 11:48:47.092886 10689 raft_consensus.cc:348] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 } } peers { permanent_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42467 } } peers { permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 } }
I20260806 11:48:47.093742 10689 raft_consensus.cc:374] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:48:47.093894 10689 raft_consensus.cc:729] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb416fa6b4fe46a4a093cd3177f96a62, State: Initialized, Role: FOLLOWER
I20260806 11:48:47.094806 10688 tablet_bootstrap.cc:492] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: No bootstrap required, opened a new log
I20260806 11:48:47.094785 10689 consensus_queue.cc:260] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 } } peers { permanent_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42467 } } peers { permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 } }
I20260806 11:48:47.095233 10688 ts_tablet_manager.cc:1397] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.000s
I20260806 11:48:47.097306 10689 ts_tablet_manager.cc:1428] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62: Time spent starting tablet: real 0.013s user 0.008s sys 0.003s
I20260806 11:48:47.106456 10687 raft_consensus.cc:348] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 } } peers { permanent_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42467 } } peers { permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 } }
I20260806 11:48:47.108742 10688 raft_consensus.cc:348] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 } } peers { permanent_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42467 } } peers { permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 } }
I20260806 11:48:47.109372 10688 raft_consensus.cc:374] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:48:47.109628 10688 raft_consensus.cc:729] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a71ae6d375b4489b03bd8e93a809e7a, State: Initialized, Role: FOLLOWER
I20260806 11:48:47.110419 10687 raft_consensus.cc:374] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:48:47.110595 10687 raft_consensus.cc:729] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b9f382d465e4dc9ba91c4a85c8a1304, State: Initialized, Role: FOLLOWER
I20260806 11:48:47.110882 10688 consensus_queue.cc:260] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 } } peers { permanent_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42467 } } peers { permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 } }
I20260806 11:48:47.111583 10687 consensus_queue.cc:260] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 } } peers { permanent_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42467 } } peers { permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 } }
I20260806 11:48:47.113790 10688 ts_tablet_manager.cc:1428] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: Time spent starting tablet: real 0.018s user 0.012s sys 0.000s
I20260806 11:48:47.113895 10687 ts_tablet_manager.cc:1428] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: Time spent starting tablet: real 0.030s user 0.012s sys 0.001s
I20260806 11:48:47.114743 10491 heartbeater.cc:503] Master 127.26.172.254:44935 was elected leader, sending a full tablet report...
I20260806 11:48:47.114735 10663 heartbeater.cc:503] Master 127.26.172.254:44935 was elected leader, sending a full tablet report...
Aug 06 11:48:47 dist-test-slave-7z32 krb5kdc[9353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016926, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
W20260806 11:48:47.170682 10492 tablet.cc:2369] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:48:47.198073 10665 tablet.cc:2369] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:48:47.202721 10299 tablet.cc:2369] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:48:47.408295 10694 raft_consensus.cc:482] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:48:47.408675 10694 raft_consensus.cc:504] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 } } peers { permanent_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42467 } } peers { permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 } }
I20260806 11:48:47.410751 10694 leader_election.cc:288] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b9f382d465e4dc9ba91c4a85c8a1304 (127.26.172.194:35697), fb416fa6b4fe46a4a093cd3177f96a62 (127.26.172.193:34501)
I20260806 11:48:47.418056 10666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.411274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35697 (local address 127.26.172.195:46845)
0806 11:48:47.411528 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0806 11:48:47.411554 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 11:48:47.411740 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:48:47.413073 (+ 1333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:48:47.413078 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:48:47.413123 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:48:47.413289 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:47.413298 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.414512 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.414517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:47.416105 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:47.416122 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.417461 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.417465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:47.417608 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.417640 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 11:48:47.417727 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 11:48:47.417846 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260806 11:48:47.418887 10681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.412463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:46845 (local address 127.26.172.194:35697)
0806 11:48:47.412657 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:47.412663 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:47.412683 (+ 20us) server_negotiation.cc:407] Connection header received
0806 11:48:47.412761 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:47.412765 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:47.412828 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:47.412918 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:48:47.413450 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.414342 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.416459 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.417150 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.417302 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.417378 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:47.418563 (+ 1185us) server_negotiation.cc:299] Negotiation successful
0806 11:48:47.418697 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 11:48:47.420233 10425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58390703a50e472aa0f30e57361ea4f0" candidate_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" is_pre_election: true
I20260806 11:48:47.420639 10425 raft_consensus.cc:2454] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a71ae6d375b4489b03bd8e93a809e7a in term 0.
I20260806 11:48:47.421479 10521 leader_election.cc:302] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a71ae6d375b4489b03bd8e93a809e7a, 8b9f382d465e4dc9ba91c4a85c8a1304; no voters:
I20260806 11:48:47.422209 10694 raft_consensus.cc:2781] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:48:47.422329 10694 raft_consensus.cc:482] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:48:47.422379 10694 raft_consensus.cc:3037] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:48:47.424431 10694 raft_consensus.cc:504] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 } } peers { permanent_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42467 } } peers { permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 } }
I20260806 11:48:47.425892 10425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58390703a50e472aa0f30e57361ea4f0" candidate_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304"
I20260806 11:48:47.425993 10694 leader_election.cc:288] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [CANDIDATE]: Term 1 election: Requested vote from peers 8b9f382d465e4dc9ba91c4a85c8a1304 (127.26.172.194:35697), fb416fa6b4fe46a4a093cd3177f96a62 (127.26.172.193:34501)
I20260806 11:48:47.426096 10425 raft_consensus.cc:3037] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:48:47.427932 10425 raft_consensus.cc:2454] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a71ae6d375b4489b03bd8e93a809e7a in term 1.
I20260806 11:48:47.428771 10521 leader_election.cc:302] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a71ae6d375b4489b03bd8e93a809e7a, 8b9f382d465e4dc9ba91c4a85c8a1304; no voters:
I20260806 11:48:47.429144 10694 raft_consensus.cc:2781] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:48:47.429457 10694 raft_consensus.cc:686] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 1 LEADER]: Becoming Leader. State: Replica: 3a71ae6d375b4489b03bd8e93a809e7a, State: Running, Role: LEADER
I20260806 11:48:47.429975 10694 consensus_queue.cc:237] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 } } peers { permanent_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42467 } } peers { permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 } }
I20260806 11:48:47.434228 10015 catalog_manager.cc:5495] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a71ae6d375b4489b03bd8e93a809e7a (127.26.172.195). New cstate: current_term: 1 leader_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 42467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 } health_report { overall_health: UNKNOWN } } }
I20260806 11:48:47.435839 10684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.412490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:44293 (local address 127.26.172.193:34501)
0806 11:48:47.412651 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:47.412656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:47.412999 (+ 343us) server_negotiation.cc:407] Connection header received
0806 11:48:47.413331 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:47.413335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:47.413394 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:47.413449 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:48:47.414142 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.419051 (+ 4909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.433938 (+ 14887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.434731 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.434910 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.434988 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:47.435517 (+ 529us) server_negotiation.cc:299] Negotiation successful
0806 11:48:47.435657 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 11:48:47.436501 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.411813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:34501 (local address 127.26.172.195:44293)
0806 11:48:47.412879 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0806 11:48:47.412896 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:48:47.413171 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:48:47.413623 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:48:47.413626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:48:47.413646 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:48:47.413990 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:47.414001 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.432125 (+ 18124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.432129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:47.433661 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:48:47.433681 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.435172 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.435177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:48:47.435310 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.435345 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 11:48:47.436142 (+ 797us) client_negotiation.cc:240] Negotiation successful
0806 11:48:47.436266 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":980,"spinlock_wait_cycles":28416,"thread_start_us":105,"threads_started":1}
I20260806 11:48:47.437464 10222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58390703a50e472aa0f30e57361ea4f0" candidate_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" is_pre_election: true
I20260806 11:48:47.437847 10222 raft_consensus.cc:2454] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a71ae6d375b4489b03bd8e93a809e7a in term 0.
I20260806 11:48:47.438284 10224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58390703a50e472aa0f30e57361ea4f0" candidate_uuid: "3a71ae6d375b4489b03bd8e93a809e7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb416fa6b4fe46a4a093cd3177f96a62"
I20260806 11:48:47.438427 10224 raft_consensus.cc:3037] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:48:47.440799 10224 raft_consensus.cc:2454] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a71ae6d375b4489b03bd8e93a809e7a in term 1.
I20260806 11:48:47.501009 10682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.495685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39992 (local address 127.26.172.195:42467)
0806 11:48:47.495881 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 11:48:47.495887 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:48:47.495908 (+ 21us) server_negotiation.cc:407] Connection header received
0806 11:48:47.496060 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:48:47.496063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:48:47.496136 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:48:47.496302 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:48:47.496676 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.497599 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.498817 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:48:47.499197 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:48:47.499335 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:48:47.499774 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:48:47.500469 (+ 695us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:48:47.500618 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 11:48:47.500736 (+ 118us) server_negotiation.cc:299] Negotiation successful
0806 11:48:47.500825 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 11:48:47.510558 10224 raft_consensus.cc:1261] T 58390703a50e472aa0f30e57361ea4f0 P fb416fa6b4fe46a4a093cd3177f96a62 [term 1 FOLLOWER]: Refusing update from remote peer 3a71ae6d375b4489b03bd8e93a809e7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:48:47.510558 10425 raft_consensus.cc:1261] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304 [term 1 FOLLOWER]: Refusing update from remote peer 3a71ae6d375b4489b03bd8e93a809e7a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:48:47.511683 10694 consensus_queue.cc:1035] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b9f382d465e4dc9ba91c4a85c8a1304" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:48:47.512035 10699 consensus_queue.cc:1035] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb416fa6b4fe46a4a093cd3177f96a62" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 34501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:48:47.525471 10712 mvcc.cc:205] Tried to move back new op lower bound from 7315525335071768576 to 7315525334758084608. Current Snapshot: MvccSnapshot[applied={T|T < 7315525335071768576}]
I20260806 11:48:47.531353 10714 mvcc.cc:205] Tried to move back new op lower bound from 7315525335071768576 to 7315525334758084608. Current Snapshot: MvccSnapshot[applied={T|T < 7315525335071768576}]
I20260806 11:48:47.541388 10015 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:48:47.541705 10015 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:48:47.546708 10015 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f949f61706ad4aadb464bb3522580fc9: Sending DeleteTablet for 3 replicas of tablet 58390703a50e472aa0f30e57361ea4f0
I20260806 11:48:47.548661 10398 tablet_service.cc:1514] Processing DeleteTablet for tablet 58390703a50e472aa0f30e57361ea4f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:48:47 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:36758
I20260806 11:48:47.550771 10579 tablet_service.cc:1514] Processing DeleteTablet for tablet 58390703a50e472aa0f30e57361ea4f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:48:47 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:39986
I20260806 11:48:47.551447 10215 tablet_service.cc:1514] Processing DeleteTablet for tablet 58390703a50e472aa0f30e57361ea4f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:48:47 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:34108
I20260806 11:48:47.552511 10724 tablet_replica.cc:330] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: stopping tablet replica
I20260806 11:48:47.553180 10724 raft_consensus.cc:2229] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:48:47.553689 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 10131
I20260806 11:48:47.553791 10724 raft_consensus.cc:2258] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:48:47.560261 10724 ts_tablet_manager.cc:1905] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:48:47.563563 10726 tablet_replica.cc:330] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: stopping tablet replica
I20260806 11:48:47.564163 10726 raft_consensus.cc:2229] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:48:47.564839 10726 raft_consensus.cc:2258] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:48:47.573313 10726 ts_tablet_manager.cc:1905] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:48:47.577822 10726 ts_tablet_manager.cc:1918] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:48:47.578006 10726 log.cc:1196] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/58390703a50e472aa0f30e57361ea4f0
I20260806 11:48:47.578483 10726 ts_tablet_manager.cc:1939] T 58390703a50e472aa0f30e57361ea4f0 P 3a71ae6d375b4489b03bd8e93a809e7a: Deleting consensus metadata
I20260806 11:48:47.578718 10724 ts_tablet_manager.cc:1918] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:48:47.580655 9994 catalog_manager.cc:4841] TS 3a71ae6d375b4489b03bd8e93a809e7a (127.26.172.195:42467): tablet 58390703a50e472aa0f30e57361ea4f0 (table test-table [id=22cc4b9796d84e7e838cee4c3a5ffb73]) successfully deleted
I20260806 11:48:47.580909 10724 log.cc:1196] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/58390703a50e472aa0f30e57361ea4f0
I20260806 11:48:47.581390 10724 ts_tablet_manager.cc:1939] T 58390703a50e472aa0f30e57361ea4f0 P 8b9f382d465e4dc9ba91c4a85c8a1304: Deleting consensus metadata
I20260806 11:48:47.583335 9998 catalog_manager.cc:4841] TS 8b9f382d465e4dc9ba91c4a85c8a1304 (127.26.172.194:35697): tablet 58390703a50e472aa0f30e57361ea4f0 (table test-table [id=22cc4b9796d84e7e838cee4c3a5ffb73]) successfully deleted
W20260806 11:48:47.590353 9998 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:34501 (error 108)
I20260806 11:48:47.591701 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 10307
I20260806 11:48:47.607761 10738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:48:47.591786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:34501 (local address 127.0.0.1:34122)
0806 11:48:47.607448 (+ 15662us) negotiation.cc:107] Waiting for socket to connect
0806 11:48:47.607618 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:34501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15535,"thread_start_us":70,"threads_started":1}
W20260806 11:48:47.608071 9998 catalog_manager.cc:4584] TS fb416fa6b4fe46a4a093cd3177f96a62 (127.26.172.193:34501): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 58390703a50e472aa0f30e57361ea4f0: Network error: Client connection negotiation failed: client connection to 127.26.172.193:34501: connect: Connection refused (error 111)
I20260806 11:48:47.620553 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 10498
I20260806 11:48:47.646929 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 9970
I20260806 11:48:47.678336 27315 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 11:48:48.026957 27315 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 11:48:48.027153 27315 mini_ranger.cc:66] Stopping Ranger...
I20260806 11:48:48.385134 27315 mini_ranger.cc:68] Stopped Ranger
2026-08-06 11:48:48.385 UTC [9399] LOG: received smart shutdown request
2026-08-06 11:48:48.391 UTC [9399] LOG: background worker "logical replication launcher" (PID 9411) exited with exit code 1
2026-08-06 11:48:48.391 UTC [9405] LOG: shutting down
2026-08-06 11:48:48.654 UTC [9399] LOG: database system is shut down
2026-08-06T11:48:48Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (66356 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:48:48 dist-test-slave-7z32 krb5kdc[10747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:48:48 dist-test-slave-7z32 krb5kdc[10747](info): set up 2 sockets
Aug 06 11:48:48 dist-test-slave-7z32 krb5kdc[10747](info): commencing operation
krb5kdc: starting...
W20260806 11:48:50.189416 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.344s user 0.001s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:48:50 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:48:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:48:50Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.172.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.172.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/rangeradmin_127.26.172.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/rangeradmin_127.26.172.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.172.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.172.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/rangerlookup_127.26.172.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/rangerlookup_127.26.172.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.172.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.172.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/HTTP_127.26.172.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/HTTP_127.26.172.212@KRBTEST.COM.keytab.
I20260806 11:48:50.435249 27315 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJj2CNI/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/postgres -l logfile start
2026-08-06 11:48:53.672 UTC [10783] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 11:48:53.672 UTC [10783] LOG: listening on IPv4 address "127.26.172.212", port 57393
2026-08-06 11:48:53.677 UTC [10783] LOG: listening on Unix socket "/tmp/.s.PGSQL.57393"
2026-08-06 11:48:53.725 UTC [10788] LOG: database system was shut down at 2026-08-06 11:48:51 UTC
2026-08-06 11:48:53.732 UTC [10783] LOG: database system is ready to accept connections
I20260806 11:48:54.940181 27315 mini_postgres.cc:96] Postgres bound to 57393
2026-08-06 11:48:54.948 UTC [10800] FATAL: database "slave" does not exist
127.26.172.212:57393 - accepting connections
I20260806 11:48:54.949863 27315 mini_ranger.cc:161] Starting Ranger...
I20260806 11:48:54.973083 27315 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 11:48:55.644025 27315 mini_ranger.cc:87] Created ranger Postgres database
I20260806 11:48:55.644145 27315 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-admin
2026-08-06 11:48:55,991 [I] DB FLAVOR :POSTGRES
2026-08-06 11:48:55,992 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 11:48:55,992 [I] Checking connection..
2026-08-06 11:48:55,992 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 11:48:56,303 [I] Checking connection passed.
2026-08-06 11:48:56,304 [I] --------- Verifying version history table ---------
2026-08-06 11:48:56,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 11:48:56,619 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 11:48:56,619 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 11:48:56,930 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 11:48:56,930 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 11:48:56,930 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 11:48:57.245 UTC [10882] WARNING: there is no transaction in progress
2026-08-06 11:48:57,257 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 11:48:57,257 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 11:48:57,572 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 11:48:57,572 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 11:48:57,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 11:48:57,835 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 11:48:58,119 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7z32.c.gcp-upstream.internal','N') ;"
2026-08-06 11:48:58,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 11:48:58,719 [I] Table x_portal_user does not exist in database ranger
2026-08-06 11:48:58,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 11:48:59,023 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 11:48:59,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 11:48:59,335 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 11:48:59,634 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 11:48:59,634 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 11:49:00.893 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:00.916 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:00.941 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:00.964 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:00.985 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.008 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.086 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.095 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.117 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.131 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.144 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.163 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.176 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.185 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.196 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:01.206 UTC [11026] WARNING: there is no transaction in progress
2026-08-06 11:49:02,133 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 11:49:02,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 11:49:02,399 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 11:49:02,399 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 11:49:02,729 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 11:49:02,729 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 11:49:03,043 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 11:49:03,044 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 11:49:03,344 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 11:49:03,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7z32.c.gcp-upstream.internal';"
2026-08-06 11:49:03,916 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 11:49:03,916 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 11:49:04,186 [I] DB_PATCHES have already been applied
I20260806 11:49:04.193351 27315 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJj2CNI/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 11:49:04.193508 27315 mini_ranger.cc:193] Using host: 127.26.172.212
I20260806 11:49:04.199553 27315 mini_ranger.cc:227] Ranger admin URL: http://127.26.172.212:36599
Aug 06, 2026 11:49:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 11:49:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 11:49:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 11:49:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 11:49:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 11:49:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 11:49:05 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 11:49:05.616258 27315 mini_ranger.cc:160] Time spent starting Ranger: real 10.666s user 0.000s sys 0.018s
Aug 06, 2026 11:49:28 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 11:49:28 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 06, 2026 11:49:28 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 11:49:28 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 11:49:29 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 11:49:30.457280 27315 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.172.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.172.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/rangerkms_127.26.172.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.172.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/rangerkms_127.26.172.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.172.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.172.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.172.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/HTTP_127.26.172.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.172.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/HTTP_127.26.172.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 11:49:30 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016970, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 11:49:30.574685 27315 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 11:49:30.591749 27315 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 11:49:31.778554 27315 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 11:49:31.778666 27315 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-kms
I20260806 11:49:31.778692 27315 mini_ranger_kms.cc:227] Using postgres at 127.26.172.212:57393
2026-08-06 11:49:31,972 [I] DB FLAVOR :POSTGRES
2026-08-06 11:49:31,973 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 11:49:31,973 [I] Checking connection
2026-08-06 11:49:31,973 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 11:49:32,295 [I] connection success
2026-08-06 11:49:32,295 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 11:49:32,295 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 11:49:32,295 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 11:49:32,590 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 11:49:32,591 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 11:49:32,591 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 11:49:32,591 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.172.212:57393/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 11:49:32,945 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 11:49:33.491899 27315 mini_ranger_kms.cc:310] Created kms service
I20260806 11:49:33.752556 27315 mini_ranger_kms.cc:326] Created kudu user
I20260806 11:49:33.812388 27315 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 11:49:33 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016970, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:49:34.261476 27315 mini_ranger_kms.cc:384] Added ranger policy
I20260806 11:49:34.261670 27315 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJj2CNI/build/debug/bin/postgresql.jar:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJj2CNI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 11:49:34.261695 27315 mini_ranger_kms.cc:240] Using host: 127.26.172.212
I20260806 11:49:34.269603 27315 mini_ranger_kms.cc:276] Ranger KMS PID: 11279
I20260806 11:49:34.269744 27315 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.172.212:49897
Aug 06, 2026 11:49:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 11:49:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 11:49:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 11:49:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 11:49:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 11:49:35 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 11:49:36 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786016976, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.172.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:37.116190 27315 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.542s user 0.016s sys 0.163s
I20260806 11:49:37.116353 27315 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 11:49:37.116448 27315 mini_ranger_kms.cc:401] 127.26.172.212:49897/kms/v1/keys
Aug 06 11:49:37 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016976, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.172.212@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
Aug 06 11:49:37 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016976, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.172.212@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
Aug 06 11:49:40 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:49:40.487568 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40231
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:40231
--ranger_config_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:49897/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:40.616382 11340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:40.616755 11340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:40.616850 11340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:40.621165 11340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:49:40.621282 11340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:40.621330 11340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:40.621389 11340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:49:40.621428 11340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:49:40.627388 11340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.172.212:49897/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:40231
--ranger_config_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:40.628722 11340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:40.629868 11340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:40.639777 11351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:40.639927 11349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:40.639904 11340 server_base.cc:1034] running on GCE node
W20260806 11:49:40.639777 11348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:40.641295 11340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:40.643378 11340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:40.644692 11340 hybrid_clock.cc:648] HybridClock initialized: now 1786016980644630 us; error 67 us; skew 500 ppm
Aug 06 11:49:40 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016980, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:40.655248 11340 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:49:40.656629 11340 webserver.cc:460] Webserver started at http://127.26.172.254:34715/ using document root <none> and password file <none>
I20260806 11:49:40.657307 11340 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:40.657378 11340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:40.657642 11340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 11:49:40 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016980, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:49:40.720916 11340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "314acbd00c83410eabbf29c1a7be6807"
format_stamp: "Formatted at 2026-08-06 11:49:40 on dist-test-slave-7z32"
server_key: "e8087e1ef75db8f515e46d0c787af31a"
server_key_iv: "29cd4ac7b5ad56a0970434c96113b459"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:40.721863 11340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "314acbd00c83410eabbf29c1a7be6807"
format_stamp: "Formatted at 2026-08-06 11:49:40 on dist-test-slave-7z32"
server_key: "e8087e1ef75db8f515e46d0c787af31a"
server_key_iv: "29cd4ac7b5ad56a0970434c96113b459"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:40.729007 11340 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260806 11:49:40.745108 11359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:40.746742 11340 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 11:49:40.746960 11340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "314acbd00c83410eabbf29c1a7be6807"
format_stamp: "Formatted at 2026-08-06 11:49:40 on dist-test-slave-7z32"
server_key: "e8087e1ef75db8f515e46d0c787af31a"
server_key_iv: "29cd4ac7b5ad56a0970434c96113b459"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:40.747123 11340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:40.765252 11340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:40.769189 11340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:40.769462 11340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:40.779245 11340 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:40231
I20260806 11:49:40.779366 11427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:40231 every 8 connection(s)
I20260806 11:49:40.780556 11340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:49:40.781474 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 11340
I20260806 11:49:40.781663 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:49:40.781989 27315 external_mini_cluster.cc:1428] Setting key c2225434dd7792df3fce47265250d930
I20260806 11:49:40.785920 11428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 11:49:40 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:40.796310 11428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: Bootstrap starting.
I20260806 11:49:40.798703 11432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:40.783958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36162 (local address 127.26.172.254:40231)
0806 11:49:40.784426 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:40.784448 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:40.784503 (+ 55us) server_negotiation.cc:407] Connection header received
0806 11:49:40.785241 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:40.785261 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:40.785645 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:40.786064 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:40.787038 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:40.788181 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:40.789123 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:40.789663 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:40.789907 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:40.793053 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:40.793076 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:40.793102 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:40.793150 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:40.795242 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:40.795785 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:40.795792 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:40.795798 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:40.795928 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:40.796249 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:40.796252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:40.796253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:40.796824 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:40.797058 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:40.797423 (+ 365us) server_negotiation.cc:299] Negotiation successful
0806 11:49:40.797793 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":158,"threads_started":1}
I20260806 11:49:40.800372 11428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:40.802225 11428 log.cc:824] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:40.805792 11428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: No bootstrap required, opened a new log
I20260806 11:49:40.810699 11428 raft_consensus.cc:348] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } }
I20260806 11:49:40.811151 11428 raft_consensus.cc:374] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:40.811208 11428 raft_consensus.cc:729] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314acbd00c83410eabbf29c1a7be6807, State: Initialized, Role: FOLLOWER
I20260806 11:49:40.811834 11428 consensus_queue.cc:260] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } }
I20260806 11:49:40.812016 11428 raft_consensus.cc:388] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:49:40.812077 11428 raft_consensus.cc:482] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:49:40.812193 11428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:40.813719 11428 raft_consensus.cc:504] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } }
I20260806 11:49:40.814260 11428 leader_election.cc:302] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 314acbd00c83410eabbf29c1a7be6807; no voters:
I20260806 11:49:40.814752 11428 leader_election.cc:288] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:49:40.815011 11434 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:49:40.815421 11434 raft_consensus.cc:686] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 1 LEADER]: Becoming Leader. State: Replica: 314acbd00c83410eabbf29c1a7be6807, State: Running, Role: LEADER
I20260806 11:49:40.815910 11434 consensus_queue.cc:237] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } }
I20260806 11:49:40.816715 11428 sys_catalog.cc:564] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:49:40.817404 11434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 314acbd00c83410eabbf29c1a7be6807. Latest consensus state: current_term: 1 leader_uuid: "314acbd00c83410eabbf29c1a7be6807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } } }
I20260806 11:49:40.817670 11434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:40.817950 11435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "314acbd00c83410eabbf29c1a7be6807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } } }
I20260806 11:49:40.818125 11435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:40.818251 11444 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:49:40.822417 11444 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:49:40.823048 11428 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 11:49:40.844941 11444 catalog_manager.cc:1347] Generated new cluster ID: 6b36c73e589447909dfa421b2570de09
I20260806 11:49:40.845077 11444 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:49:40.859699 11444 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:49:40.862949 11444 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:49:40.877094 11444 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: Generated new TSK 0
I20260806 11:49:40.878854 11444 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:49:41.770916 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:49897/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40231
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:41.972923 11483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:41.973332 11483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:41.973382 11483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:41.979548 11483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:41.979688 11483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:41.979799 11483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:49:41.988384 11483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.172.212:49897/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:41.990188 11483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:41.991825 11483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:42.008909 11501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:42.008911 11494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:42.009428 11497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:42.010962 11483 server_base.cc:1034] running on GCE node
I20260806 11:49:42.011627 11483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:42.012661 11483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:42.013885 11483 hybrid_clock.cc:648] HybridClock initialized: now 1786016982013830 us; error 82 us; skew 500 ppm
Aug 06 11:49:42 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:42.018311 11483 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:49:42.019917 11483 webserver.cc:460] Webserver started at http://127.26.172.193:37919/ using document root <none> and password file <none>
I20260806 11:49:42.020746 11483 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:42.020857 11483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:42.021226 11483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 11:49:42 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:49:42.054890 11483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "dc839277ad4d4552a63b75ccee7a645d"
format_stamp: "Formatted at 2026-08-06 11:49:42 on dist-test-slave-7z32"
server_key: "c2c4cf90be52eceacd9b3acbc9b3ea49"
server_key_iv: "ae721d4f825d21102974f881b1578c87"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:42.056063 11483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "dc839277ad4d4552a63b75ccee7a645d"
format_stamp: "Formatted at 2026-08-06 11:49:42 on dist-test-slave-7z32"
server_key: "c2c4cf90be52eceacd9b3acbc9b3ea49"
server_key_iv: "ae721d4f825d21102974f881b1578c87"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:42.064743 11483 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.000s
I20260806 11:49:42.107963 11515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:42.110044 11483 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:49:42.110251 11483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "dc839277ad4d4552a63b75ccee7a645d"
format_stamp: "Formatted at 2026-08-06 11:49:42 on dist-test-slave-7z32"
server_key: "c2c4cf90be52eceacd9b3acbc9b3ea49"
server_key_iv: "ae721d4f825d21102974f881b1578c87"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:42.110450 11483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:42.137524 11483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:42.141749 11483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:42.141981 11483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:42.142800 11483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:42.144765 11483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:42.144841 11483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:42.144912 11483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:42.144939 11483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 11:49:42 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786016982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:42.166420 11483 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:40633
I20260806 11:49:42.167816 11483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:49:42.168757 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 11483
I20260806 11:49:42.168965 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:49:42.169435 27315 external_mini_cluster.cc:1428] Setting key e8eee5ba9478c6c0e7b110e1e399c063
I20260806 11:49:42.174816 11671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:40633 every 8 connection(s)
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
Aug 06 11:49:42 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:42.228408 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:42.170694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:57905 (local address 127.26.172.254:40231)
0806 11:49:42.175146 (+ 4452us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:42.175152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:42.176588 (+ 1436us) server_negotiation.cc:407] Connection header received
0806 11:49:42.178374 (+ 1786us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:42.178378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:42.178448 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:42.178583 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:42.203024 (+ 24441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:42.204141 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:42.211096 (+ 6955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:42.211591 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:42.211719 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:42.221932 (+ 10213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:42.221939 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:42.221943 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:42.222000 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:42.224539 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:42.225670 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:42.225678 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:42.225681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:42.225919 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:42.226620 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:42.226624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:42.226626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:42.226978 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:42.227086 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:42.227966 (+ 880us) server_negotiation.cc:299] Negotiation successful
0806 11:49:42.228183 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4350,"thread_start_us":241,"threads_started":1}
I20260806 11:49:42.230335 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:42.171209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40231 (local address 127.26.172.193:57905)
0806 11:49:42.175998 (+ 4789us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:42.176102 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:42.177943 (+ 1841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:42.194704 (+ 16761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:42.194726 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:42.195410 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:42.201443 (+ 6033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:42.201486 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:42.204431 (+ 2945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:42.204435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:42.206375 (+ 1940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:42.206396 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:42.212133 (+ 5737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:42.212139 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:42.212507 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:42.217128 (+ 4621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:42.217166 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:42.219556 (+ 2390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:42.224794 (+ 5238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:42.224807 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:42.224843 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:42.225398 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:42.226124 (+ 726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:42.226130 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:42.226133 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:42.226473 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:42.227171 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:42.227182 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:42.227614 (+ 432us) client_negotiation.cc:769] Sending connection context
0806 11:49:42.228654 (+ 1040us) client_negotiation.cc:240] Negotiation successful
0806 11:49:42.229134 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4439,"thread_start_us":170,"threads_started":1}
I20260806 11:49:42.232002 11672 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40231
I20260806 11:49:42.232297 11672 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:42.233002 11672 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
I20260806 11:49:42.235009 11375 ts_manager.cc:194] Registered new tserver with Master: dc839277ad4d4552a63b75ccee7a645d (127.26.172.193:40633)
I20260806 11:49:42.236776 11375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:57905
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:49:42.247233 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:49897/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40231
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:42.434250 11681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:42.434629 11681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:42.434760 11681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:42.441305 11681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:42.441499 11681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:42.441640 11681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:49:42.451646 11681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.172.212:49897/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:42.454260 11681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:42.456386 11681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:42.472494 11689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:42.472494 11694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:42.473703 11690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:42.473675 11681 server_base.cc:1034] running on GCE node
I20260806 11:49:42.474673 11681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:42.476099 11681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:42.480650 11681 hybrid_clock.cc:648] HybridClock initialized: now 1786016982480530 us; error 132 us; skew 500 ppm
Aug 06 11:49:42 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:42.486614 11681 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:49:42.488085 11681 webserver.cc:460] Webserver started at http://127.26.172.194:38483/ using document root <none> and password file <none>
I20260806 11:49:42.488854 11681 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:42.488933 11681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:42.489243 11681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 11:49:42 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:49:42.505705 11681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "3da024fe1fb24af4989083f61d852fd7"
format_stamp: "Formatted at 2026-08-06 11:49:42 on dist-test-slave-7z32"
server_key: "20aab7ea72264f0e9d36d68ccfa47979"
server_key_iv: "a4ae0857d8d07414af2d8424ed86e6fb"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:42.506446 11681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "3da024fe1fb24af4989083f61d852fd7"
format_stamp: "Formatted at 2026-08-06 11:49:42 on dist-test-slave-7z32"
server_key: "20aab7ea72264f0e9d36d68ccfa47979"
server_key_iv: "a4ae0857d8d07414af2d8424ed86e6fb"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:42.516724 11681 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.007s sys 0.000s
I20260806 11:49:42.541453 11704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:42.543430 11681 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.000s
I20260806 11:49:42.543597 11681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "3da024fe1fb24af4989083f61d852fd7"
format_stamp: "Formatted at 2026-08-06 11:49:42 on dist-test-slave-7z32"
server_key: "20aab7ea72264f0e9d36d68ccfa47979"
server_key_iv: "a4ae0857d8d07414af2d8424ed86e6fb"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:42.543752 11681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:42.564447 11681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:42.568774 11681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:42.569007 11681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:42.569762 11681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:42.570983 11681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:42.571053 11681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:42.571125 11681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:42.571157 11681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:42.582450 11681 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:35505
I20260806 11:49:42.585242 11681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:49:42.587651 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 11681
I20260806 11:49:42.587855 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:49:42.588349 27315 external_mini_cluster.cc:1428] Setting key 0a809dc0580c6524b71cfca6e58e5353
I20260806 11:49:42.588347 11855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:35505 every 8 connection(s)
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
Aug 06 11:49:42 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:42.623351 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:42.593127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:38203 (local address 127.26.172.254:40231)
0806 11:49:42.593270 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:42.593276 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:42.600376 (+ 7100us) server_negotiation.cc:407] Connection header received
0806 11:49:42.602060 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:42.602065 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:42.602149 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:42.602239 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:42.610406 (+ 8167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:42.611343 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:42.613554 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:42.613961 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:42.614066 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:42.617848 (+ 3782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:42.617854 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:42.617858 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:42.617898 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:42.619893 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:42.620689 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:42.620693 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:42.620695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:42.620808 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:42.621309 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:42.621313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:42.621315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:42.621572 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:42.621664 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:42.622998 (+ 1334us) server_negotiation.cc:299] Negotiation successful
0806 11:49:42.623167 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:49:42.629201 11860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:42.593716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40231 (local address 127.26.172.194:38203)
0806 11:49:42.600094 (+ 6378us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:42.600199 (+ 105us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:42.601595 (+ 1396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:42.602891 (+ 1296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:42.602905 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:42.603400 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:42.604306 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:42.604334 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:42.611609 (+ 7275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:42.611613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:42.613306 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:42.613330 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:42.614362 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:42.614367 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:42.614627 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:42.615517 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:42.615542 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:42.617548 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:42.620087 (+ 2539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:42.620096 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:42.620122 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:42.620545 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:42.620950 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:42.620953 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:42.620955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:42.621183 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:42.621739 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:42.621747 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:42.622150 (+ 403us) client_negotiation.cc:769] Sending connection context
0806 11:49:42.624150 (+ 2000us) client_negotiation.cc:240] Negotiation successful
0806 11:49:42.624576 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5987,"thread_start_us":195,"threads_started":1}
I20260806 11:49:42.631321 11857 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40231
I20260806 11:49:42.631632 11857 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:42.632349 11857 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
I20260806 11:49:42.633848 11375 ts_manager.cc:194] Registered new tserver with Master: 3da024fe1fb24af4989083f61d852fd7 (127.26.172.194:35505)
I20260806 11:49:42.634629 11375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:38203
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:49:42.660333 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:49897/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40231
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:49:42 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016982, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
W20260806 11:49:42.976272 11863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:42.977001 11863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:42.977152 11863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:42.986442 11863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:42.986972 11863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:42.987170 11863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:49:42.997514 11863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.172.212:49897/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:42.999928 11863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:43.001929 11863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:43.050129 11869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:43.050129 11870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:43.050365 11863 server_base.cc:1034] running on GCE node
W20260806 11:49:43.050132 11872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:43.051323 11863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:43.052449 11863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:43.053639 11863 hybrid_clock.cc:648] HybridClock initialized: now 1786016983053609 us; error 51 us; skew 500 ppm
Aug 06 11:49:43 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:43.058444 11863 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:49:43.060097 11863 webserver.cc:460] Webserver started at http://127.26.172.195:40259/ using document root <none> and password file <none>
I20260806 11:49:43.061071 11863 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:43.061189 11863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:43.061532 11863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 11:49:43 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:49:43.104843 11863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "b89dd30af1144839accecf289be12322"
format_stamp: "Formatted at 2026-08-06 11:49:43 on dist-test-slave-7z32"
server_key: "a409b850244a62187dce3964f650cd7a"
server_key_iv: "f3a916b8e3acbe769970a4c1d6242158"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:43.105870 11863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "b89dd30af1144839accecf289be12322"
format_stamp: "Formatted at 2026-08-06 11:49:43 on dist-test-slave-7z32"
server_key: "a409b850244a62187dce3964f650cd7a"
server_key_iv: "f3a916b8e3acbe769970a4c1d6242158"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:43.119549 11863 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.009s sys 0.000s
I20260806 11:49:43.137252 11881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:43.139097 11863 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 11:49:43.139242 11863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "b89dd30af1144839accecf289be12322"
format_stamp: "Formatted at 2026-08-06 11:49:43 on dist-test-slave-7z32"
server_key: "a409b850244a62187dce3964f650cd7a"
server_key_iv: "f3a916b8e3acbe769970a4c1d6242158"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:43.139532 11863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:43.175326 11863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:43.179617 11863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:43.179828 11863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:43.180665 11863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:43.181771 11863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:43.181843 11863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:43.181900 11863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:43.181923 11863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:43.195596 11863 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:35649
I20260806 11:49:43.196872 11863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:49:43.198758 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 11863
I20260806 11:49:43.198933 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:49:43.199281 27315 external_mini_cluster.cc:1428] Setting key 8e23927a0e60483257e4134edc7ae750
I20260806 11:49:43.198078 12027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:35649 every 8 connection(s)
Aug 06 11:49:43 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:43.217468 12030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:43.203592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:59917 (local address 127.26.172.254:40231)
0806 11:49:43.203842 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:43.203848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:43.204780 (+ 932us) server_negotiation.cc:407] Connection header received
0806 11:49:43.205861 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:43.205864 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:43.205928 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:43.206024 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:43.207258 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:43.207833 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:43.209010 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:43.209251 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:43.209371 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:43.212701 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:43.212706 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:43.212709 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:43.212740 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:43.214677 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:43.215387 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:43.215391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:43.215393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:43.215497 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:43.215925 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:43.215932 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:43.215933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:43.216273 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:43.216403 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:43.216998 (+ 595us) server_negotiation.cc:299] Negotiation successful
0806 11:49:43.217138 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":80,"threads_started":1}
I20260806 11:49:43.218788 12032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:43.204133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40231 (local address 127.26.172.195:59917)
0806 11:49:43.204630 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:43.204684 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:43.205631 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:43.206224 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:43.206231 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:43.206525 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:43.207107 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:43.207123 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:43.207980 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:43.207984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:43.208877 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:43.208887 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:43.209478 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:43.209485 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:43.209642 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:43.210518 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:43.210537 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:43.212491 (+ 1954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:43.214850 (+ 2359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:43.214860 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:43.214880 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:43.215242 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:43.215639 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:43.215641 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:43.215643 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:43.215793 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:43.216415 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:43.216425 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:43.216707 (+ 282us) client_negotiation.cc:769] Sending connection context
0806 11:49:43.216931 (+ 224us) client_negotiation.cc:240] Negotiation successful
0806 11:49:43.217370 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":146,"threads_started":1}
I20260806 11:49:43.220124 12028 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40231
I20260806 11:49:43.220400 12028 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:43.220985 12028 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
I20260806 11:49:43.222222 11375 ts_manager.cc:194] Registered new tserver with Master: b89dd30af1144839accecf289be12322 (127.26.172.195:35649)
I20260806 11:49:43.222934 11375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:59917
I20260806 11:49:43.227087 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:49:43.227977 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 11483
I20260806 11:49:43.271551 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 11681
I20260806 11:49:43.292344 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 11863
I20260806 11:49:43.304268 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 11340
I20260806 11:49:43.324386 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40231
--webserver_interface=127.26.172.254
--webserver_port=34715
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:40231
--ranger_config_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:49897/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.172.212:49897/kms with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:43.457885 12035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:43.458217 12035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:43.458277 12035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:43.462536 12035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:49:43.462682 12035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:43.462723 12035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:43.462759 12035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:49:43.462786 12035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:49:43.468598 12035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.172.212:49897/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:40231
--ranger_config_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=34715
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:43.470269 12035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:43.471778 12035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:43.483180 12041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:43.483278 12043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:43.483343 12040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:43.483729 12035 server_base.cc:1034] running on GCE node
I20260806 11:49:43.485232 12035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:43.486903 12035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:43.488147 12035 hybrid_clock.cc:648] HybridClock initialized: now 1786016983488124 us; error 43 us; skew 500 ppm
Aug 06 11:49:43 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:43.491847 12035 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:49:43.493146 12035 webserver.cc:460] Webserver started at http://127.26.172.254:34715/ using document root <none> and password file <none>
I20260806 11:49:43.493911 12035 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:43.493996 12035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 11:49:43 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:49:43.583294 12035 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:49:43.586362 12051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:43.588474 12035 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:49:43.588740 12035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "314acbd00c83410eabbf29c1a7be6807"
format_stamp: "Formatted at 2026-08-06 11:49:40 on dist-test-slave-7z32"
server_key: "e8087e1ef75db8f515e46d0c787af31a"
server_key_iv: "29cd4ac7b5ad56a0970434c96113b459"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:43.589555 12035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:43.619061 12035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:43.622884 12035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:43.623152 12035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:43.632872 12035 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:40231
I20260806 11:49:43.632892 12125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:40231 every 8 connection(s)
I20260806 11:49:43.634347 12035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:49:43.636871 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 12035
I20260806 11:49:43.637501 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:49897/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:40633
--local_ip_for_outbound_sockets=127.26.172.193
--tserver_master_addrs=127.26.172.254:40231
--webserver_port=37919
--webserver_interface=127.26.172.193
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.172.212:49897/kms with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:49:43.639940 12126 sys_catalog.cc:263] Verifying existing consensus state
I20260806 11:49:43.641891 12126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: Bootstrap starting.
I20260806 11:49:43.659906 12126 log.cc:824] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:43.667237 12126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:49:43.667683 12126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: Bootstrap complete.
I20260806 11:49:43.672010 12126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } }
I20260806 11:49:43.672477 12126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314acbd00c83410eabbf29c1a7be6807, State: Initialized, Role: FOLLOWER
I20260806 11:49:43.673090 12126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } }
I20260806 11:49:43.673250 12126 raft_consensus.cc:388] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:49:43.673350 12126 raft_consensus.cc:482] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:49:43.673480 12126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 1 FOLLOWER]: Advancing to term 2
I20260806 11:49:43.675721 12126 raft_consensus.cc:504] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } }
I20260806 11:49:43.676095 12126 leader_election.cc:302] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 314acbd00c83410eabbf29c1a7be6807; no voters:
I20260806 11:49:43.676471 12126 leader_election.cc:288] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 11:49:43.676568 12131 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 11:49:43.676774 12131 raft_consensus.cc:686] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [term 2 LEADER]: Becoming Leader. State: Replica: 314acbd00c83410eabbf29c1a7be6807, State: Running, Role: LEADER
I20260806 11:49:43.677142 12131 consensus_queue.cc:237] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } }
I20260806 11:49:43.677956 12126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:49:43.678197 12131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 314acbd00c83410eabbf29c1a7be6807. Latest consensus state: current_term: 2 leader_uuid: "314acbd00c83410eabbf29c1a7be6807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } } }
I20260806 11:49:43.678314 12131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:43.678725 12141 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:49:43.679401 12133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "314acbd00c83410eabbf29c1a7be6807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "314acbd00c83410eabbf29c1a7be6807" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40231 } } }
I20260806 11:49:43.679677 12133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807 [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:43.682564 12141 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:49:43.683317 12141 catalog_manager.cc:1259] Loaded cluster ID: 6b36c73e589447909dfa421b2570de09
I20260806 11:49:43.683393 12126 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 11:49:43.683389 12141 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:49:43.692546 12141 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:49:43.694289 12141 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: Loaded TSK: 0
I20260806 11:49:43.696569 12141 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 11:49:43.823037 12129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:43.823650 12129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:43.823761 12129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:43.829695 12129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:43.829829 12129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:43.829949 12129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:49:43.836830 12129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.172.212:49897/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:40633
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=37919
--tserver_master_addrs=127.26.172.254:40231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:43.838569 12129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:43.840320 12129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:43.854719 12184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:43.855047 12181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:43.855751 12180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:43.856271 12129 server_base.cc:1034] running on GCE node
I20260806 11:49:43.857136 12129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:43.858347 12129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:43.859820 12129 hybrid_clock.cc:648] HybridClock initialized: now 1786016983859787 us; error 59 us; skew 500 ppm
Aug 06 11:49:43 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:43.864423 12129 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:49:43.866044 12129 webserver.cc:460] Webserver started at http://127.26.172.193:37919/ using document root <none> and password file <none>
I20260806 11:49:43.867012 12129 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:43.867158 12129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 11:49:43 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:49:43.901929 12129 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.003s sys 0.001s
I20260806 11:49:43.908632 12196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:43.911321 12129 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.004s sys 0.000s
I20260806 11:49:43.911545 12129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "dc839277ad4d4552a63b75ccee7a645d"
format_stamp: "Formatted at 2026-08-06 11:49:42 on dist-test-slave-7z32"
server_key: "c2c4cf90be52eceacd9b3acbc9b3ea49"
server_key_iv: "ae721d4f825d21102974f881b1578c87"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:43.912617 12129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:43.947371 12129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:43.952273 12129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:43.952602 12129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:43.953548 12129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:43.955004 12129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:43.955094 12129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:43.955179 12129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:43.955209 12129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:43.974900 12129 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:40633
I20260806 11:49:43.975628 12339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:40633 every 8 connection(s)
I20260806 11:49:43.977270 12129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:49:43.982421 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 12129
I20260806 11:49:43.983201 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:49897/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:35505
--local_ip_for_outbound_sockets=127.26.172.194
--tserver_master_addrs=127.26.172.254:40231
--webserver_port=38483
--webserver_interface=127.26.172.194
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.172.212:49897/kms with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:49:43 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016983, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:44.009171 12343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:43.981128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40231 (local address 127.26.172.193:36683)
0806 11:49:43.983233 (+ 2105us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:43.983565 (+ 332us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:43.984515 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:43.986665 (+ 2150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:43.986674 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:43.987129 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:43.987836 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:43.987858 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:43.989820 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:43.989824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:43.991344 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:43.991357 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:43.992700 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:43.992705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:43.992898 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:43.993654 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:43.993680 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:43.996510 (+ 2830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:44.004502 (+ 7992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:44.004512 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:44.004542 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:44.004954 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:44.005503 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:44.005507 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:44.005509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:44.005735 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:44.006623 (+ 888us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:44.006632 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:44.007097 (+ 465us) client_negotiation.cc:769] Sending connection context
0806 11:49:44.007341 (+ 244us) client_negotiation.cc:240] Negotiation successful
0806 11:49:44.007833 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1832,"thread_start_us":213,"threads_started":1}
I20260806 11:49:44.009151 12342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:43.981073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:36683 (local address 127.26.172.254:40231)
0806 11:49:43.984994 (+ 3921us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:43.985011 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:43.985047 (+ 36us) server_negotiation.cc:407] Connection header received
0806 11:49:43.985318 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:43.985328 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:43.985665 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:43.986078 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:43.988080 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:43.989635 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:43.991519 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:43.992252 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:43.992447 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:43.996799 (+ 4352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:43.996807 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:43.996827 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:43.996875 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:44.004223 (+ 7348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:44.005159 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:44.005166 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:44.005171 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:44.005363 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:44.005856 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:44.005858 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:44.005860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:44.006467 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:44.007015 (+ 548us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:44.007500 (+ 485us) server_negotiation.cc:299] Negotiation successful
0806 11:49:44.007833 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3717,"thread_start_us":101,"threads_started":1}
I20260806 11:49:44.013504 12340 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40231
I20260806 11:49:44.013900 12340 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:44.014747 12340 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
W20260806 11:49:44.018023 12340 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:40231 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 11:49:44.018244 12340 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:44.018545 12340 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
I20260806 11:49:44.020165 12340 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:44.020468 12340 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
W20260806 11:49:44.021792 12340 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 11:49:44.185134 12344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:44.185603 12344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:44.185695 12344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:44.192198 12344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:44.192312 12344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:44.192418 12344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:49:44.200994 12344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.172.212:49897/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:35505
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=38483
--tserver_master_addrs=127.26.172.254:40231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:44.202585 12344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:44.204150 12344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:44.225016 12355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:44.225752 12354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:44.226472 12357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:44.226872 12344 server_base.cc:1034] running on GCE node
I20260806 11:49:44.227463 12344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:44.228443 12344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:44.229660 12344 hybrid_clock.cc:648] HybridClock initialized: now 1786016984229623 us; error 48 us; skew 500 ppm
Aug 06 11:49:44 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016984, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:44.233349 12344 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:49:44.234704 12344 webserver.cc:460] Webserver started at http://127.26.172.194:38483/ using document root <none> and password file <none>
I20260806 11:49:44.235517 12344 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:44.235647 12344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 11:49:44 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016984, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:49:44.258049 12344 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:49:44.262883 12367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:44.265244 12344 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:49:44.265486 12344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "3da024fe1fb24af4989083f61d852fd7"
format_stamp: "Formatted at 2026-08-06 11:49:42 on dist-test-slave-7z32"
server_key: "20aab7ea72264f0e9d36d68ccfa47979"
server_key_iv: "a4ae0857d8d07414af2d8424ed86e6fb"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:44.266522 12344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:44.290094 12344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:44.296638 12344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:44.296945 12344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:44.298034 12344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:44.299623 12344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:44.299705 12344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:44.299775 12344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:44.299819 12344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:44.313817 12344 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:35505
I20260806 11:49:44.313838 12518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:35505 every 8 connection(s)
I20260806 11:49:44.315420 12344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:49:44.318476 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 12344
I20260806 11:49:44.319164 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.172.212:49897/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:35649
--local_ip_for_outbound_sockets=127.26.172.195
--tserver_master_addrs=127.26.172.254:40231
--webserver_port=40259
--webserver_interface=127.26.172.195
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:39041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.172.212:49897/kms with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:49:44 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016984, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:44.340672 12342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:44.318098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:33373 (local address 127.26.172.254:40231)
0806 11:49:44.318314 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:44.318320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:44.320400 (+ 2080us) server_negotiation.cc:407] Connection header received
0806 11:49:44.322025 (+ 1625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:44.322032 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:44.322107 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:44.322171 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:44.324238 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:44.325131 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:44.327256 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:44.327623 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:44.327751 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:44.335649 (+ 7898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:44.335655 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:44.335659 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:44.335702 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:44.337644 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:44.338355 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:44.338359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:44.338360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:44.338448 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:44.339035 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:44.339039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:44.339042 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:44.339296 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:44.339419 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:44.340185 (+ 766us) server_negotiation.cc:299] Negotiation successful
0806 11:49:44.340381 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 11:49:44.341837 12522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:44.318711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40231 (local address 127.26.172.194:33373)
0806 11:49:44.320109 (+ 1398us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:44.320206 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:44.321682 (+ 1476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:44.322701 (+ 1019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:44.322712 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:44.323180 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:44.323979 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:44.324002 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:44.325386 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:44.325391 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:44.327077 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:44.327095 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:44.331525 (+ 4430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:44.331532 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:44.331860 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:44.332894 (+ 1034us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:44.332923 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:44.335278 (+ 2355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:44.337803 (+ 2525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:44.337812 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:44.337842 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:44.338207 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:44.338553 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:44.338557 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:44.338568 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:44.338905 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:44.339420 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:44.339431 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:44.339873 (+ 442us) client_negotiation.cc:769] Sending connection context
0806 11:49:44.340128 (+ 255us) client_negotiation.cc:240] Negotiation successful
0806 11:49:44.340603 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1009,"thread_start_us":173,"threads_started":1}
I20260806 11:49:44.343663 12519 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40231
I20260806 11:49:44.343973 12519 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:44.344673 12519 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
W20260806 11:49:44.346902 12519 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:40231 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 11:49:44.347086 12519 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:44.347369 12519 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
I20260806 11:49:44.348429 12519 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:44.348650 12519 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
W20260806 11:49:44.349514 12519 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 11:49:44.489161 12523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:44.489590 12523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:44.489663 12523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:44.496057 12523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:44.496155 12523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:44.496268 12523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:49:44.504637 12523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:39041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.172.212:49897/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:35649
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=40259
--tserver_master_addrs=127.26.172.254:40231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:44.506480 12523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:44.508100 12523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:44.522769 12533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:44.523311 12531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:44.523612 12530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:44.524426 12523 server_base.cc:1034] running on GCE node
I20260806 11:49:44.525004 12523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:44.525957 12523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:44.527156 12523 hybrid_clock.cc:648] HybridClock initialized: now 1786016984527112 us; error 53 us; skew 500 ppm
Aug 06 11:49:44 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016984, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:44.531538 12523 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:49:44.533042 12523 webserver.cc:460] Webserver started at http://127.26.172.195:40259/ using document root <none> and password file <none>
I20260806 11:49:44.534027 12523 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:44.534166 12523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 11:49:44 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016984, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:49:44.556954 12523 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:49:44.561096 12544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:44.563169 12523 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:49:44.563357 12523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "b89dd30af1144839accecf289be12322"
format_stamp: "Formatted at 2026-08-06 11:49:43 on dist-test-slave-7z32"
server_key: "a409b850244a62187dce3964f650cd7a"
server_key_iv: "f3a916b8e3acbe769970a4c1d6242158"
server_key_version: "kuduclusterkey@0"
I20260806 11:49:44.564013 12523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:44.580952 12523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:44.585724 12523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:44.585999 12523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:44.587002 12523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:44.588426 12523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:44.588510 12523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:44.588594 12523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:44.588636 12523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:44.603968 12523 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:35649
I20260806 11:49:44.605825 12523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:49:44.610188 12698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:35649 every 8 connection(s)
I20260806 11:49:44.611300 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 12523
I20260806 11:49:44.635824 12342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:44.612444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36170 (local address 127.26.172.254:40231)
0806 11:49:44.612611 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:44.612616 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:44.618592 (+ 5976us) server_negotiation.cc:407] Connection header received
0806 11:49:44.618802 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:44.618806 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:44.618920 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:44.619079 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:44.625253 (+ 6174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:44.626063 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:44.627429 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:44.627847 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:44.627981 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:44.630372 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:44.630377 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:44.630380 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:44.630418 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:44.633007 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:44.633743 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:44.633748 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:44.633750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:44.633905 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:44.634356 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:44.634361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:44.634363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:44.634681 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:44.634979 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:44.635392 (+ 413us) server_negotiation.cc:299] Negotiation successful
0806 11:49:44.635592 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 11:49:44 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016984, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:44.655786 12703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:44.617722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:36039 (local address 127.26.172.254:40231)
0806 11:49:44.620426 (+ 2704us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:44.620438 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:44.620463 (+ 25us) server_negotiation.cc:407] Connection header received
0806 11:49:44.622497 (+ 2034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:44.622502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:44.622581 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:44.622676 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:44.624617 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:44.625636 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:44.629611 (+ 3975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:44.630115 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:44.630262 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:44.637950 (+ 7688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:44.637955 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:44.637958 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:44.637995 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:44.640247 (+ 2252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:44.641209 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:44.641214 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:44.641216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:44.641379 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:44.641843 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:44.641846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:44.641847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:44.642201 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:44.642306 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:44.655199 (+ 12893us) server_negotiation.cc:299] Negotiation successful
0806 11:49:44.655482 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2589,"thread_start_us":164,"threads_started":1}
I20260806 11:49:44.657905 12702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:44.616100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40231 (local address 127.26.172.195:36039)
0806 11:49:44.619182 (+ 3082us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:44.619260 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:44.622069 (+ 2809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:44.623012 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:44.623026 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:44.623493 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:44.624373 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:44.624407 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:44.625839 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:44.625844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:44.629361 (+ 3517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:44.629385 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:44.630562 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:44.630571 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:44.630906 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:44.631961 (+ 1055us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:44.631989 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:44.637460 (+ 5471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:44.640448 (+ 2988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:44.640458 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:44.640487 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:44.641068 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:44.641496 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:44.641500 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:44.641502 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:44.641720 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:44.642375 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:44.642385 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:44.642897 (+ 512us) client_negotiation.cc:769] Sending connection context
0806 11:49:44.643173 (+ 276us) client_negotiation.cc:240] Negotiation successful
0806 11:49:44.656640 (+ 13467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2764,"thread_start_us":264,"threads_started":1}
I20260806 11:49:44.659739 12699 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40231
I20260806 11:49:44.660106 12699 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:44.660868 12699 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
I20260806 11:49:44.663610 12075 ts_manager.cc:194] Registered new tserver with Master: b89dd30af1144839accecf289be12322 (127.26.172.195:35649)
I20260806 11:49:44.665591 12075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:36039
Aug 06 11:49:44 dist-test-slave-7z32 krb5kdc[10747](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786016984, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:45.022123 12340 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:45.022645 12340 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
I20260806 11:49:45.023953 12075 ts_manager.cc:194] Registered new tserver with Master: dc839277ad4d4552a63b75ccee7a645d (127.26.172.193:40633)
I20260806 11:49:45.024983 12075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:36683
I20260806 11:49:45.349839 12519 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:45.350296 12519 heartbeater.cc:511] Master 127.26.172.254:40231 requested a full tablet report, sending...
I20260806 11:49:45.351429 12075 ts_manager.cc:194] Registered new tserver with Master: 3da024fe1fb24af4989083f61d852fd7 (127.26.172.194:35505)
I20260806 11:49:45.352249 12075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:33373
I20260806 11:49:45.361214 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:49:45.377732 12716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.364404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36176 (local address 127.26.172.254:40231)
0806 11:49:45.364737 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:45.364769 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:45.367265 (+ 2496us) server_negotiation.cc:407] Connection header received
0806 11:49:45.367493 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:45.367497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:45.367572 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:45.367697 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:45.368653 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.369457 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.370508 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.370943 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.371071 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.373314 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:45.373321 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:45.373329 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:45.373358 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:45.375491 (+ 2133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:45.376038 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:45.376044 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:45.376046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:45.376154 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:45.376597 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:45.376601 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:45.376603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:45.376859 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:45.377031 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:45.377317 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 11:49:45.377481 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":139,"threads_started":1}
I20260806 11:49:45.383431 12075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:49:45.388775 12075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:49:45.418653 12724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.406122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35505 (local address 127.0.0.1:46618)
0806 11:49:45.409137 (+ 3015us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:45.409151 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:45.409251 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:45.410069 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:45.410076 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:45.410102 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:45.410255 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:45.410263 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.411822 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.411826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:45.413324 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:45.413337 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.417930 (+ 4593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.417933 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:45.418071 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.418127 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 11:49:45.418292 (+ 165us) client_negotiation.cc:240] Negotiation successful
0806 11:49:45.418464 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2951,"thread_start_us":89,"threads_started":1}
I20260806 11:49:45.419435 12728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.406586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46618 (local address 127.26.172.194:35505)
0806 11:49:45.408956 (+ 2370us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:45.408964 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:45.409364 (+ 400us) server_negotiation.cc:407] Connection header received
0806 11:49:45.409463 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:45.409469 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:45.409705 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:45.409864 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:45.410419 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.411669 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.413752 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.414659 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.414800 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.414996 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:45.419131 (+ 4135us) server_negotiation.cc:299] Negotiation successful
0806 11:49:45.419263 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2247,"thread_start_us":119,"threads_started":1}
I20260806 11:49:45.421018 12729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.407719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:40633 (local address 127.0.0.1:46312)
0806 11:49:45.411124 (+ 3405us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:45.411144 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:45.411285 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:45.414660 (+ 3375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:45.414664 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:45.414686 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:45.414873 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:45.414885 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.417545 (+ 2660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.417549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:45.418921 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:45.418939 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.420413 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.420417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:45.420627 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.420666 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 11:49:45.420728 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 11:49:45.420828 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3304,"thread_start_us":96,"threads_started":1}
I20260806 11:49:45.423146 12730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.408017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46312 (local address 127.26.172.193:40633)
0806 11:49:45.413833 (+ 5816us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:45.413842 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:45.413876 (+ 34us) server_negotiation.cc:407] Connection header received
0806 11:49:45.413982 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:45.413988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:45.414276 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:45.414460 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:45.415037 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.417400 (+ 2363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.419114 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.420234 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.422507 (+ 2273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.422721 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:45.422795 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 11:49:45.422960 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5650,"thread_start_us":150,"threads_started":1}
I20260806 11:49:45.423147 12429 tablet_service.cc:1467] Processing CreateTablet for tablet c4a72e61e8094fe0b3699e755e6c9fd7 (DEFAULT_TABLE table=test-table [id=4ebfd24bf4434350a9a7126627d58ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:49:45.426882 12253 tablet_service.cc:1467] Processing CreateTablet for tablet c4a72e61e8094fe0b3699e755e6c9fd7 (DEFAULT_TABLE table=test-table [id=4ebfd24bf4434350a9a7126627d58ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:49:45.428231 12253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4a72e61e8094fe0b3699e755e6c9fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:45.431138 12429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4a72e61e8094fe0b3699e755e6c9fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:45.433980 12726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.404698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:35649 (local address 127.0.0.1:52056)
0806 11:49:45.408432 (+ 3734us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:45.408494 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:45.408644 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:45.413483 (+ 4839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:45.413487 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:45.413508 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:45.413601 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:45.413606 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.416537 (+ 2931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.416541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:45.417763 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:45.417777 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.433330 (+ 15553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.433336 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:45.433473 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.433508 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 11:49:45.433623 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 11:49:45.433753 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3507,"thread_start_us":120,"threads_started":1}
I20260806 11:49:45.434787 12725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.404904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52056 (local address 127.26.172.195:35649)
0806 11:49:45.411623 (+ 6719us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:45.411633 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:45.411668 (+ 35us) server_negotiation.cc:407] Connection header received
0806 11:49:45.411780 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:45.411788 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:45.413120 (+ 1332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:45.413364 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:45.415115 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.416367 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.431044 (+ 14677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.432782 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.432985 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.433201 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:45.434441 (+ 1240us) server_negotiation.cc:299] Negotiation successful
0806 11:49:45.434608 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6560,"thread_start_us":200,"threads_started":1}
I20260806 11:49:45.439332 12615 tablet_service.cc:1467] Processing CreateTablet for tablet c4a72e61e8094fe0b3699e755e6c9fd7 (DEFAULT_TABLE table=test-table [id=4ebfd24bf4434350a9a7126627d58ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:49:45.440562 12615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4a72e61e8094fe0b3699e755e6c9fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:45.448953 12734 tablet_bootstrap.cc:492] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d: Bootstrap starting.
I20260806 11:49:45.451512 12734 tablet_bootstrap.cc:654] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:45.452481 12734 log.cc:824] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:45.455197 12734 tablet_bootstrap.cc:492] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d: No bootstrap required, opened a new log
I20260806 11:49:45.455444 12734 ts_tablet_manager.cc:1397] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 11:49:45.455710 12732 tablet_bootstrap.cc:492] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7: Bootstrap starting.
I20260806 11:49:45.460448 12732 tablet_bootstrap.cc:654] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:45.461719 12732 log.cc:824] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:45.463063 12737 tablet_bootstrap.cc:492] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: Bootstrap starting.
I20260806 11:49:45.463092 12734 raft_consensus.cc:348] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 } } peers { permanent_uuid: "3da024fe1fb24af4989083f61d852fd7" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35505 } } peers { permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 } }
I20260806 11:49:45.463482 12734 raft_consensus.cc:374] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:45.463550 12734 raft_consensus.cc:729] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc839277ad4d4552a63b75ccee7a645d, State: Initialized, Role: FOLLOWER
I20260806 11:49:45.464131 12734 consensus_queue.cc:260] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 } } peers { permanent_uuid: "3da024fe1fb24af4989083f61d852fd7" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35505 } } peers { permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 } }
I20260806 11:49:45.466609 12737 tablet_bootstrap.cc:654] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:45.471362 12732 tablet_bootstrap.cc:492] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7: No bootstrap required, opened a new log
I20260806 11:49:45.471742 12732 ts_tablet_manager.cc:1397] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.000s
I20260806 11:49:45.476451 12734 ts_tablet_manager.cc:1428] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20260806 11:49:45.476971 12340 heartbeater.cc:503] Master 127.26.172.254:40231 was elected leader, sending a full tablet report...
I20260806 11:49:45.477917 12732 raft_consensus.cc:348] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 } } peers { permanent_uuid: "3da024fe1fb24af4989083f61d852fd7" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35505 } } peers { permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 } }
I20260806 11:49:45.478534 12732 raft_consensus.cc:374] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:45.478673 12732 raft_consensus.cc:729] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3da024fe1fb24af4989083f61d852fd7, State: Initialized, Role: FOLLOWER
I20260806 11:49:45.479945 12732 consensus_queue.cc:260] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 } } peers { permanent_uuid: "3da024fe1fb24af4989083f61d852fd7" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35505 } } peers { permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 } }
W20260806 11:49:45.480594 12341 tablet.cc:2369] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:49:45.481593 12732 ts_tablet_manager.cc:1428] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260806 11:49:45.482009 12737 log.cc:824] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:45.482997 12519 heartbeater.cc:503] Master 127.26.172.254:40231 was elected leader, sending a full tablet report...
I20260806 11:49:45.485467 12737 tablet_bootstrap.cc:492] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: No bootstrap required, opened a new log
I20260806 11:49:45.485769 12737 ts_tablet_manager.cc:1397] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s
I20260806 11:49:45.488776 12742 raft_consensus.cc:482] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:49:45.491932 12737 raft_consensus.cc:348] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 } } peers { permanent_uuid: "3da024fe1fb24af4989083f61d852fd7" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35505 } } peers { permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 } }
I20260806 11:49:45.492319 12737 raft_consensus.cc:374] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:45.492391 12737 raft_consensus.cc:729] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b89dd30af1144839accecf289be12322, State: Initialized, Role: FOLLOWER
I20260806 11:49:45.492951 12737 consensus_queue.cc:260] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 } } peers { permanent_uuid: "3da024fe1fb24af4989083f61d852fd7" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35505 } } peers { permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 } }
I20260806 11:49:45.489043 12742 raft_consensus.cc:504] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 } } peers { permanent_uuid: "3da024fe1fb24af4989083f61d852fd7" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35505 } } peers { permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 } }
I20260806 11:49:45.494343 12737 ts_tablet_manager.cc:1428] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: Time spent starting tablet: real 0.008s user 0.008s sys 0.001s
I20260806 11:49:45.494968 12699 heartbeater.cc:503] Master 127.26.172.254:40231 was elected leader, sending a full tablet report...
Aug 06 11:49:45 dist-test-slave-7z32 krb5kdc[10747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016984, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for HTTP/127.26.172.212@KRBTEST.COM
I20260806 11:49:45.497197 12742 leader_election.cc:288] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b89dd30af1144839accecf289be12322 (127.26.172.195:35649), dc839277ad4d4552a63b75ccee7a645d (127.26.172.193:40633)
I20260806 11:49:45.502195 12725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.496357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:44609 (local address 127.26.172.195:35649)
0806 11:49:45.497255 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:45.497262 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:45.497279 (+ 17us) server_negotiation.cc:407] Connection header received
0806 11:49:45.497345 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:45.497351 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:45.497409 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:45.497518 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:45.498018 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.498800 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.500689 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.501365 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.501472 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.501540 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:45.501940 (+ 400us) server_negotiation.cc:299] Negotiation successful
0806 11:49:45.502040 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":793}
I20260806 11:49:45.503044 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.495678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:35649 (local address 127.26.172.194:44609)
0806 11:49:45.496615 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:45.496634 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:45.497045 (+ 411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:45.497574 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:45.497579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:45.497623 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:45.497811 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:45.497819 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.499013 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.499017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:45.500521 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:45.500534 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.501654 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.501658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:45.501780 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.501806 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 11:49:45.502719 (+ 913us) client_negotiation.cc:240] Negotiation successful
0806 11:49:45.502853 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"mutex_wait_us":32,"thread_start_us":212,"threads_started":1}
I20260806 11:49:45.503489 12730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.496862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:42051 (local address 127.26.172.193:40633)
0806 11:49:45.497061 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:45.497067 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:45.497996 (+ 929us) server_negotiation.cc:407] Connection header received
0806 11:49:45.498286 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:45.498292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:45.498371 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:45.498431 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:45.499304 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.500282 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.501909 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.502520 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.502652 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.502724 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:45.503206 (+ 482us) server_negotiation.cc:299] Negotiation successful
0806 11:49:45.503312 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 11:49:45.504557 12749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.496668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:40633 (local address 127.26.172.194:42051)
0806 11:49:45.497864 (+ 1196us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:45.497882 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:45.498101 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:45.498630 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:45.498636 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:45.498661 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:45.499036 (+ 375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:45.499079 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.500450 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.500453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:45.501715 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:45.501729 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.502875 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.502880 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:45.503015 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.503047 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 11:49:45.504239 (+ 1192us) client_negotiation.cc:240] Negotiation successful
0806 11:49:45.504349 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1112,"mutex_wait_us":63,"thread_start_us":150,"threads_started":1}
I20260806 11:49:45.504638 12638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a72e61e8094fe0b3699e755e6c9fd7" candidate_uuid: "3da024fe1fb24af4989083f61d852fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89dd30af1144839accecf289be12322" is_pre_election: true
I20260806 11:49:45.504995 12638 raft_consensus.cc:2454] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3da024fe1fb24af4989083f61d852fd7 in term 0.
I20260806 11:49:45.505360 12276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a72e61e8094fe0b3699e755e6c9fd7" candidate_uuid: "3da024fe1fb24af4989083f61d852fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc839277ad4d4552a63b75ccee7a645d" is_pre_election: true
I20260806 11:49:45.505885 12276 raft_consensus.cc:2454] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3da024fe1fb24af4989083f61d852fd7 in term 0.
I20260806 11:49:45.506703 12368 leader_election.cc:302] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3da024fe1fb24af4989083f61d852fd7, dc839277ad4d4552a63b75ccee7a645d; no voters:
I20260806 11:49:45.507519 12742 raft_consensus.cc:2781] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:49:45.507633 12742 raft_consensus.cc:482] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:49:45.507689 12742 raft_consensus.cc:3037] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:45.509624 12742 raft_consensus.cc:504] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 } } peers { permanent_uuid: "3da024fe1fb24af4989083f61d852fd7" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35505 } } peers { permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 } }
I20260806 11:49:45.510161 12742 leader_election.cc:288] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [CANDIDATE]: Term 1 election: Requested vote from peers b89dd30af1144839accecf289be12322 (127.26.172.195:35649), dc839277ad4d4552a63b75ccee7a645d (127.26.172.193:40633)
I20260806 11:49:45.511132 12638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a72e61e8094fe0b3699e755e6c9fd7" candidate_uuid: "3da024fe1fb24af4989083f61d852fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b89dd30af1144839accecf289be12322"
I20260806 11:49:45.511137 12276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4a72e61e8094fe0b3699e755e6c9fd7" candidate_uuid: "3da024fe1fb24af4989083f61d852fd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc839277ad4d4552a63b75ccee7a645d"
I20260806 11:49:45.511328 12638 raft_consensus.cc:3037] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:45.511363 12276 raft_consensus.cc:3037] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:45.512895 12276 raft_consensus.cc:2454] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3da024fe1fb24af4989083f61d852fd7 in term 1.
I20260806 11:49:45.513145 12638 raft_consensus.cc:2454] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3da024fe1fb24af4989083f61d852fd7 in term 1.
I20260806 11:49:45.513986 12368 leader_election.cc:302] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3da024fe1fb24af4989083f61d852fd7, dc839277ad4d4552a63b75ccee7a645d; no voters:
I20260806 11:49:45.514410 12742 raft_consensus.cc:2781] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:49:45.514760 12742 raft_consensus.cc:686] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 1 LEADER]: Becoming Leader. State: Replica: 3da024fe1fb24af4989083f61d852fd7, State: Running, Role: LEADER
I20260806 11:49:45.515344 12742 consensus_queue.cc:237] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 } } peers { permanent_uuid: "3da024fe1fb24af4989083f61d852fd7" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35505 } } peers { permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 } }
I20260806 11:49:45.521639 12074 catalog_manager.cc:5495] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3da024fe1fb24af4989083f61d852fd7 (127.26.172.194). New cstate: current_term: 1 leader_uuid: "3da024fe1fb24af4989083f61d852fd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3da024fe1fb24af4989083f61d852fd7" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 } health_report { overall_health: UNKNOWN } } }
I20260806 11:49:45.546096 12728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.539755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46630 (local address 127.26.172.194:35505)
0806 11:49:45.539900 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:45.539905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:45.539919 (+ 14us) server_negotiation.cc:407] Connection header received
0806 11:49:45.540002 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:45.540005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:45.540077 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:45.540192 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:49:45.540613 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.541593 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.542917 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:45.543252 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:45.543342 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:45.544001 (+ 659us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:49:45.544923 (+ 922us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:49:45.545106 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:45.545786 (+ 680us) server_negotiation.cc:299] Negotiation successful
0806 11:49:45.545877 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 11:49:45.556421 12276 raft_consensus.cc:1261] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d [term 1 FOLLOWER]: Refusing update from remote peer 3da024fe1fb24af4989083f61d852fd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:49:45.557541 12742 consensus_queue.cc:1035] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc839277ad4d4552a63b75ccee7a645d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 40633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:49:45.566135 12638 raft_consensus.cc:1261] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322 [term 1 FOLLOWER]: Refusing update from remote peer 3da024fe1fb24af4989083f61d852fd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:49:45.567445 12742 consensus_queue.cc:1035] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b89dd30af1144839accecf289be12322" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 35649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 11:49:45.573079 12520 tablet.cc:2369] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:49:45.585211 12755 mvcc.cc:205] Tried to move back new op lower bound from 7315525572823760896 to 7315525572676689920. Current Snapshot: MvccSnapshot[applied={T|T < 7315525572823760896}]
I20260806 11:49:45.588574 12754 mvcc.cc:205] Tried to move back new op lower bound from 7315525572823760896 to 7315525572676689920. Current Snapshot: MvccSnapshot[applied={T|T < 7315525572823760896}]
I20260806 11:49:45.603313 12074 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:49:45.603596 12074 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:49:45.604362 12759 mvcc.cc:205] Tried to move back new op lower bound from 7315525572823760896 to 7315525572676689920. Current Snapshot: MvccSnapshot[applied={T|T < 7315525572823760896}]
I20260806 11:49:45.607416 12074 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 314acbd00c83410eabbf29c1a7be6807: Sending DeleteTablet for 3 replicas of tablet c4a72e61e8094fe0b3699e755e6c9fd7
I20260806 11:49:45.608702 12429 tablet_service.cc:1514] Processing DeleteTablet for tablet c4a72e61e8094fe0b3699e755e6c9fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:49:45 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:46618
I20260806 11:49:45.610253 12615 tablet_service.cc:1514] Processing DeleteTablet for tablet c4a72e61e8094fe0b3699e755e6c9fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:49:45 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:52056
I20260806 11:49:45.611195 12253 tablet_service.cc:1514] Processing DeleteTablet for tablet c4a72e61e8094fe0b3699e755e6c9fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:49:45 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:46312
I20260806 11:49:45.612290 12768 tablet_replica.cc:330] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: stopping tablet replica
I20260806 11:49:45.612593 12769 tablet_replica.cc:330] T c4a72e61e8094fe0b3699e755e6c9fd7 P dc839277ad4d4552a63b75ccee7a645d: stopping tablet replica
I20260806 11:49:45.612823 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 12129
I20260806 11:49:45.613284 12768 raft_consensus.cc:2229] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:49:45.614272 12768 raft_consensus.cc:2258] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:49:45.616554 12767 tablet_replica.cc:330] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7: stopping tablet replica
I20260806 11:49:45.618170 12768 ts_tablet_manager.cc:1905] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:49:45.618678 12767 raft_consensus.cc:2229] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:49:45.619282 12767 raft_consensus.cc:2258] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:49:45.623162 12768 ts_tablet_manager.cc:1918] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:49:45.623893 12768 log.cc:1196] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/c4a72e61e8094fe0b3699e755e6c9fd7
I20260806 11:49:45.624432 12768 ts_tablet_manager.cc:1939] T c4a72e61e8094fe0b3699e755e6c9fd7 P b89dd30af1144839accecf289be12322: Deleting consensus metadata
I20260806 11:49:45.626502 12053 catalog_manager.cc:4841] TS b89dd30af1144839accecf289be12322 (127.26.172.195:35649): tablet c4a72e61e8094fe0b3699e755e6c9fd7 (table test-table [id=4ebfd24bf4434350a9a7126627d58ed4]) successfully deleted
I20260806 11:49:45.629134 12767 ts_tablet_manager.cc:1905] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:49:45.632465 12767 ts_tablet_manager.cc:1918] T c4a72e61e8094fe0b3699e755e6c9fd7 P 3da024fe1fb24af4989083f61d852fd7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260806 11:49:45.640070 12053 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:40633 (error 108)
I20260806 11:49:45.641650 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 12344
I20260806 11:49:45.660290 12726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.659763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:40633 (local address 127.0.0.1:46328)
0806 11:49:45.660051 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:45.660154 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:40633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
W20260806 11:49:45.660597 12053 catalog_manager.cc:4584] TS dc839277ad4d4552a63b75ccee7a645d (127.26.172.193:40633): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c4a72e61e8094fe0b3699e755e6c9fd7: Network error: Client connection negotiation failed: client connection to 127.26.172.193:40633: connect: Connection refused (error 111)
I20260806 11:49:45.673712 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 12523
I20260806 11:49:45.679467 12726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:45.673990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35505 (local address 127.0.0.1:46644)
0806 11:49:45.679174 (+ 5184us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:45.679297 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.194:35505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4979}
I20260806 11:49:45.696170 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 12035
I20260806 11:49:45.716141 27315 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 11:49:46.065397 27315 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 11:49:46.065582 27315 mini_ranger.cc:66] Stopping Ranger...
I20260806 11:49:46.412501 27315 mini_ranger.cc:68] Stopped Ranger
2026-08-06 11:49:46.413 UTC [10783] LOG: received smart shutdown request
2026-08-06 11:49:46.418 UTC [10783] LOG: background worker "logical replication launcher" (PID 10798) exited with exit code 1
2026-08-06 11:49:46.419 UTC [10790] LOG: shutting down
2026-08-06 11:49:46.640 UTC [10783] LOG: database system is shut down
2026-08-06T11:49:46Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (57960 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:49:46 dist-test-slave-7z32 krb5kdc[12780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:49:46 dist-test-slave-7z32 krb5kdc[12780](info): set up 2 sockets
Aug 06 11:49:46 dist-test-slave-7z32 krb5kdc[12780](info): commencing operation
krb5kdc: starting...
W20260806 11:49:48.131808 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.327s user 0.000s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:49:48 dist-test-slave-7z32 krb5kdc[12780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:49:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:49:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:49:48.296283 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:42513
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:36219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:42513,127.26.172.253:36017,127.26.172.252:36671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:48.429630 12795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:48.429953 12795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:48.429998 12795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:48.434233 12795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:49:48.434322 12795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:48.434343 12795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:48.434361 12795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:49:48.434377 12795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:49:48.439952 12795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:36219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:42513,127.26.172.253:36017,127.26.172.252:36671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:42513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:48.441082 12795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:48.442137 12795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:48.451900 12804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:48.451978 12803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:48.451849 12807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:48.452411 12795 server_base.cc:1034] running on GCE node
I20260806 11:49:48.453050 12795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:48.454276 12795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:48.455590 12795 hybrid_clock.cc:648] HybridClock initialized: now 1786016988455517 us; error 95 us; skew 500 ppm
Aug 06 11:49:48 dist-test-slave-7z32 krb5kdc[12780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:48.459178 12795 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:49:48.460337 12795 webserver.cc:460] Webserver started at http://127.26.172.254:39975/ using document root <none> and password file <none>
I20260806 11:49:48.461061 12795 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:48.461162 12795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:48.461431 12795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:49:48.463761 12795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "070367af594d473796c064627650dd90"
format_stamp: "Formatted at 2026-08-06 11:49:48 on dist-test-slave-7z32"
server_key: "df06a2a921d803c9b8716ae6839270da"
server_key_iv: "55ac25cff15bb4f419b088666dc837ad"
server_key_version: "encryptionkey@0"
I20260806 11:49:48.464378 12795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "070367af594d473796c064627650dd90"
format_stamp: "Formatted at 2026-08-06 11:49:48 on dist-test-slave-7z32"
server_key: "df06a2a921d803c9b8716ae6839270da"
server_key_iv: "55ac25cff15bb4f419b088666dc837ad"
server_key_version: "encryptionkey@0"
I20260806 11:49:48.469053 12795 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 11:49:48.472249 12816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:48.473851 12795 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260806 11:49:48.474032 12795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "070367af594d473796c064627650dd90"
format_stamp: "Formatted at 2026-08-06 11:49:48 on dist-test-slave-7z32"
server_key: "df06a2a921d803c9b8716ae6839270da"
server_key_iv: "55ac25cff15bb4f419b088666dc837ad"
server_key_version: "encryptionkey@0"
I20260806 11:49:48.474159 12795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:48.489027 12795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:48.492658 12795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:48.492890 12795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:48.501541 12795 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:42513
I20260806 11:49:48.502074 12883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:42513 every 8 connection(s)
I20260806 11:49:48.502682 12795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:49:48.506693 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 12795
I20260806 11:49:48.506875 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:49:48.507233 27315 external_mini_cluster.cc:1428] Setting key f52c88830bf229e3925b40cca9b85af0
I20260806 11:49:48.507992 12886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:48.513622 12886 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.172.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.253@KRBTEST.COM" created.
Aug 06 11:49:48 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:48.535030 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.517248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:42513 (local address 127.0.0.1:54372)
0806 11:49:48.518091 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.518150 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:48.519318 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:48.520496 (+ 1178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:48.520503 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:48.521086 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:48.521427 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:48.521441 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.522725 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.522727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:48.523749 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:48.523762 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.524689 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.524697 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:48.524895 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:48.525698 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:48.525725 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:48.528037 (+ 2312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:48.530713 (+ 2676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:48.530726 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:48.530741 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:48.531132 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:48.531529 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:48.531532 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:48.531534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:48.531760 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:48.532775 (+ 1015us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:48.532789 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:48.533064 (+ 275us) client_negotiation.cc:769] Sending connection context
0806 11:49:48.533352 (+ 288us) client_negotiation.cc:240] Negotiation successful
0806 11:49:48.533729 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"spinlock_wait_cycles":39168,"thread_start_us":248,"threads_started":1}
I20260806 11:49:48.535118 12890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.517246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54372 (local address 127.26.172.254:42513)
0806 11:49:48.517951 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:48.517979 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:48.518311 (+ 332us) server_negotiation.cc:407] Connection header received
0806 11:49:48.519838 (+ 1527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:48.519848 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:48.520113 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:48.520449 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:48.521616 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.522574 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.523922 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.524454 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.524632 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:48.528254 (+ 3622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:48.528262 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:48.528278 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:48.528304 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:48.530555 (+ 2251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:48.531279 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:48.531285 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:48.531287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:48.531413 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:48.531876 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:48.531881 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:48.531888 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:48.532494 (+ 606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:48.532693 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:48.533595 (+ 902us) server_negotiation.cc:299] Negotiation successful
0806 11:49:48.533828 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":258,"threads_started":1}
I20260806 11:49:48.538429 12886 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } has no permanent_uuid. Determining permanent_uuid...
I20260806 11:49:48.539754 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.539300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52444)
0806 11:49:48.539518 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.539637 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260806 11:49:48.540046 12820 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
I20260806 11:49:48.541743 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.541090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52456)
0806 11:49:48.541328 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.541654 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260806 11:49:48.542032 12886 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:36017: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab.
Entry for principal kudu/127.26.172.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab.
I20260806 11:49:48.543792 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.253:36017
--webserver_interface=127.26.172.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab
--principal=kudu/127.26.172.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:36219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:42513,127.26.172.253:36017,127.26.172.252:36671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:49:48.591470 12886 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } attempt: 1
I20260806 11:49:48.592757 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.592357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52464)
0806 11:49:48.592571 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.592667 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260806 11:49:48.593897 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.593645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52476)
0806 11:49:48.593778 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.593840 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260806 11:49:48.594043 12886 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:36017: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
I20260806 11:49:48.662230 12886 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } attempt: 2
I20260806 11:49:48.663563 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.663164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52482)
0806 11:49:48.663385 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.663473 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260806 11:49:48.664651 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.664382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52492)
0806 11:49:48.664533 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.664590 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260806 11:49:48.664853 12886 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:36017: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
W20260806 11:49:48.690304 12895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:48.690718 12895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:48.690770 12895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:48.695369 12895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:49:48.695466 12895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:48.695487 12895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:48.695506 12895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:49:48.695523 12895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:49:48.701606 12895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:36219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:42513,127.26.172.253:36017,127.26.172.252:36671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab
--principal=kudu/127.26.172.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.253:36017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.172.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:48.703230 12895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:48.704599 12895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:48.715768 12900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:48.716316 12902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:48.716424 12904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:48.716574 12895 server_base.cc:1034] running on GCE node
I20260806 11:49:48.717376 12895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:48.718739 12895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:48.719941 12895 hybrid_clock.cc:648] HybridClock initialized: now 1786016988719907 us; error 54 us; skew 500 ppm
Aug 06 11:49:48 dist-test-slave-7z32 krb5kdc[12780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:48.723727 12895 init.cc:377] Logged in from keytab as kudu/127.26.172.253@KRBTEST.COM (short username kudu)
I20260806 11:49:48.724901 12895 webserver.cc:460] Webserver started at http://127.26.172.253:42979/ using document root <none> and password file <none>
I20260806 11:49:48.725594 12895 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:48.725704 12895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:48.725981 12895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:49:48.728461 12895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/data/instance:
uuid: "25d9ca1acfe44da69f8d4631b283f903"
format_stamp: "Formatted at 2026-08-06 11:49:48 on dist-test-slave-7z32"
server_key: "bf2438af47476ea381a482c41da08818"
server_key_iv: "c9aecc116b2ef7d8148fc9ca58e6a40e"
server_key_version: "encryptionkey@0"
I20260806 11:49:48.729125 12895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/wal/instance:
uuid: "25d9ca1acfe44da69f8d4631b283f903"
format_stamp: "Formatted at 2026-08-06 11:49:48 on dist-test-slave-7z32"
server_key: "bf2438af47476ea381a482c41da08818"
server_key_iv: "c9aecc116b2ef7d8148fc9ca58e6a40e"
server_key_version: "encryptionkey@0"
I20260806 11:49:48.733935 12895 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 11:49:48.737612 12913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:48.739480 12895 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:49:48.739674 12895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/wal
uuid: "25d9ca1acfe44da69f8d4631b283f903"
format_stamp: "Formatted at 2026-08-06 11:49:48 on dist-test-slave-7z32"
server_key: "bf2438af47476ea381a482c41da08818"
server_key_iv: "c9aecc116b2ef7d8148fc9ca58e6a40e"
server_key_version: "encryptionkey@0"
I20260806 11:49:48.739816 12895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:48.756070 12886 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } attempt: 3
I20260806 11:49:48.757261 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.756876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52502)
0806 11:49:48.757059 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.757149 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 11:49:48.758061 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.757835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52512)
0806 11:49:48.757945 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.758002 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 11:49:48.758210 12886 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:36017: Network error: Client connection negotiation failed: client connection to 127.26.172.253:36017: connect: Connection refused (error 111)
I20260806 11:49:48.787644 12895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:48.791812 12895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:48.792085 12895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:48.802021 12895 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.253:36017
I20260806 11:49:48.802104 12978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.253:36017 every 8 connection(s)
I20260806 11:49:48.803403 12895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
I20260806 11:49:48.806191 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 12895
I20260806 11:49:48.806389 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-1/wal/instance
I20260806 11:49:48.806813 27315 external_mini_cluster.cc:1428] Setting key 950e12856d6d4489ab8ea8ee378aa232
I20260806 11:49:48.808547 12979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:48.814437 12979 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.172.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.252@KRBTEST.COM" created.
Aug 06 11:49:48 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:48.835353 12890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.817586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47344 (local address 127.26.172.254:42513)
0806 11:49:48.817790 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:48.817794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:48.819446 (+ 1652us) server_negotiation.cc:407] Connection header received
0806 11:49:48.820868 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:48.820871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:48.820954 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:48.821112 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:48.822992 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.823857 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.825923 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.826178 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.826287 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:48.829776 (+ 3489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:48.829783 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:48.829788 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:48.829840 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:48.831964 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:48.832885 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:48.832892 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:48.832896 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:48.833006 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:48.833511 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:48.833516 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:48.833519 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:48.833823 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:48.833939 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:48.835051 (+ 1112us) server_negotiation.cc:299] Negotiation successful
0806 11:49:48.835192 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 11:49:48.836743 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.818309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:42513 (local address 127.0.0.1:47344)
0806 11:49:48.819161 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.819237 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:48.820490 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:48.821384 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:48.821393 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:48.822002 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:48.822719 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:48.822738 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.824043 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.824046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:48.825718 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:48.825737 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.826412 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.826419 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:48.826719 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:48.827574 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:48.827596 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:48.829489 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:48.832182 (+ 2693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:48.832191 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:48.832215 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:48.832700 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:48.833147 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:48.833150 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:48.833152 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:48.833359 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:48.833988 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:48.833996 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:48.834449 (+ 453us) client_negotiation.cc:769] Sending connection context
0806 11:49:48.834932 (+ 483us) client_negotiation.cc:240] Negotiation successful
0806 11:49:48.835380 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":195,"threads_started":1}
I20260806 11:49:48.839171 12979 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab.
Entry for principal kudu/127.26.172.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab.
I20260806 11:49:48.844182 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.252:36671
--webserver_interface=127.26.172.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab
--principal=kudu/127.26.172.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:36219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:42513,127.26.172.253:36017,127.26.172.252:36671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:49:48 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
I20260806 11:49:48.853708 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.840030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52514)
0806 11:49:48.840263 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.840282 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:48.840413 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:48.841441 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:48.841444 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:48.841654 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:48.841891 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:48.841900 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.843251 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.843255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:48.843990 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:48.844004 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.844949 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.844956 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:48.845139 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:48.845842 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:48.845864 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:48.847982 (+ 2118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:48.851270 (+ 3288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:48.851274 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:48.851275 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:48.851565 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:48.852058 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:48.852063 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:48.852065 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:48.852168 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:48.853076 (+ 908us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:48.853079 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:48.853272 (+ 193us) client_negotiation.cc:769] Sending connection context
0806 11:49:48.853399 (+ 127us) client_negotiation.cc:240] Negotiation successful
0806 11:49:48.853556 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260806 11:49:48.854262 12985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.840289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52514 (local address 127.26.172.253:36017)
0806 11:49:48.840845 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:48.840858 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:48.840888 (+ 30us) server_negotiation.cc:407] Connection header received
0806 11:49:48.840944 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:48.840950 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:48.841255 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:48.841433 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:48.842042 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.843100 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.844166 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.844780 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.844879 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:48.848225 (+ 3346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:48.848246 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:48.848274 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:48.848319 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:48.851062 (+ 2743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:48.851740 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:48.851752 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:48.851756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:48.851904 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:48.852291 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:48.852297 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:48.852302 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:48.852881 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:48.853098 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:48.853604 (+ 506us) server_negotiation.cc:299] Negotiation successful
0806 11:49:48.853938 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":272,"threads_started":1}
I20260806 11:49:48.857479 12979 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } has no permanent_uuid. Determining permanent_uuid...
I20260806 11:49:48.858603 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.858079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48532)
0806 11:49:48.858305 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.858456 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260806 11:49:48.858984 12916 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
I20260806 11:49:48.860090 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.859740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48546)
0806 11:49:48.859917 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.859997 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260806 11:49:48.860354 12979 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:36671: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
I20260806 11:49:48.901482 12886 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } attempt: 4
Aug 06 11:49:48 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
I20260806 11:49:48.909675 12979 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } attempt: 1
I20260806 11:49:48.910487 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.910194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48562)
0806 11:49:48.910338 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.910405 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 11:49:48.911631 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.911405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48570)
0806 11:49:48.911511 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.911564 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 11:49:48.911777 12979 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:36671: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
I20260806 11:49:48.915369 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.902287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52524)
0806 11:49:48.902657 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.902681 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:48.902911 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:48.903431 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:48.903434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:48.903732 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:48.903914 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:48.903922 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.904992 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.904996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:48.906611 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:48.906625 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.907266 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.907271 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:48.907389 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:48.908077 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:48.908094 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:48.909946 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:48.913309 (+ 3363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:48.913317 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:48.913322 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:48.913617 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:48.913999 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:48.914001 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:48.914003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:48.914088 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:48.914801 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:48.914807 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:48.915018 (+ 211us) client_negotiation.cc:769] Sending connection context
0806 11:49:48.915123 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 11:49:48.915253 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208}
I20260806 11:49:48.915565 12985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.902533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52524 (local address 127.26.172.253:36017)
0806 11:49:48.902717 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:48.902721 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:48.902785 (+ 64us) server_negotiation.cc:407] Connection header received
0806 11:49:48.903168 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:48.903174 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:48.903245 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:48.903347 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:48.904145 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.904841 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.906793 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:48.907113 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:48.907221 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:48.910186 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:48.910191 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:48.910195 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:48.910363 (+ 168us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:48.913104 (+ 2741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:48.913752 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:48.913756 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:48.913758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:48.913865 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:48.914191 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:48.914194 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:48.914196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:48.914649 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:48.914790 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:48.915221 (+ 431us) server_negotiation.cc:299] Negotiation successful
0806 11:49:48.915377 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 11:49:48.916571 12886 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } has no permanent_uuid. Determining permanent_uuid...
I20260806 11:49:48.917503 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.917230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48576)
0806 11:49:48.917376 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.917434 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 11:49:48.918581 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.918309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48582)
0806 11:49:48.918467 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.918524 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260806 11:49:48.918896 12886 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:36671: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
I20260806 11:49:48.978122 12886 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } attempt: 1
I20260806 11:49:48.979625 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.979178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48596)
0806 11:49:48.979432 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.979523 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260806 11:49:48.979955 12979 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } attempt: 2
I20260806 11:49:48.980834 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.980488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48612)
0806 11:49:48.980705 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.980758 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260806 11:49:48.980882 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.980488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48616)
0806 11:49:48.980653 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.980753 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 11:49:48.981086 12886 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:36671: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
I20260806 11:49:48.981787 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:48.981560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48630)
0806 11:49:48.981670 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:48.981724 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 11:49:48.982016 12979 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:36671: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
W20260806 11:49:49.005167 12986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:49.005638 12986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:49.005751 12986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:49.010497 12986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:49:49.010654 12986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:49.010694 12986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:49.010736 12986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:49:49.010798 12986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:49:49.017387 12986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:36219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:42513,127.26.172.253:36017,127.26.172.252:36671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab
--principal=kudu/127.26.172.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.252:36671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.172.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:49.019179 12986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:49.020618 12986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:49.031988 12997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:49.032058 12995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:49.032021 12993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:49.032466 12986 server_base.cc:1034] running on GCE node
I20260806 11:49:49.033349 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:49.034719 12986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:49.035924 12986 hybrid_clock.cc:648] HybridClock initialized: now 1786016989035894 us; error 53 us; skew 500 ppm
Aug 06 11:49:49 dist-test-slave-7z32 krb5kdc[12780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016989, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:49.039692 12986 init.cc:377] Logged in from keytab as kudu/127.26.172.252@KRBTEST.COM (short username kudu)
I20260806 11:49:49.040864 12986 webserver.cc:460] Webserver started at http://127.26.172.252:38747/ using document root <none> and password file <none>
I20260806 11:49:49.041549 12986 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:49.041654 12986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:49.041922 12986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:49:49.044370 12986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/data/instance:
uuid: "fbba4dcaa738437496b63a3455d88399"
format_stamp: "Formatted at 2026-08-06 11:49:49 on dist-test-slave-7z32"
server_key: "6e2c2c5dfdd1fdcb2144e1a1019dfc1f"
server_key_iv: "a6ae4ea26fac9bf1d4e58eafabb23120"
server_key_version: "encryptionkey@0"
I20260806 11:49:49.045038 12986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/wal/instance:
uuid: "fbba4dcaa738437496b63a3455d88399"
format_stamp: "Formatted at 2026-08-06 11:49:49 on dist-test-slave-7z32"
server_key: "6e2c2c5dfdd1fdcb2144e1a1019dfc1f"
server_key_iv: "a6ae4ea26fac9bf1d4e58eafabb23120"
server_key_version: "encryptionkey@0"
I20260806 11:49:49.048324 12886 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } attempt: 2
I20260806 11:49:49.049484 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.049041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48636)
0806 11:49:49.049268 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:49.049373 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 11:49:49.050061 12986 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:49:49.050329 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.050104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48640)
0806 11:49:49.050217 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:49.050277 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 11:49:49.050472 12886 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:36671: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
I20260806 11:49:49.053313 13007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:49.055146 12986 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 11:49:49.055315 12986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/wal
uuid: "fbba4dcaa738437496b63a3455d88399"
format_stamp: "Formatted at 2026-08-06 11:49:49 on dist-test-slave-7z32"
server_key: "6e2c2c5dfdd1fdcb2144e1a1019dfc1f"
server_key_iv: "a6ae4ea26fac9bf1d4e58eafabb23120"
server_key_version: "encryptionkey@0"
I20260806 11:49:49.055445 12986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:49.073210 12979 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } attempt: 3
I20260806 11:49:49.074424 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.073998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48642)
0806 11:49:49.074219 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:49.074307 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 11:49:49.075459 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.075177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48648)
0806 11:49:49.075346 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:49.075403 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260806 11:49:49.075657 12979 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:36671: Network error: Client connection negotiation failed: client connection to 127.26.172.252:36671: connect: Connection refused (error 111)
I20260806 11:49:49.081085 12986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:49.084899 12986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:49.085150 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:49.093721 12986 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.252:36671
I20260806 11:49:49.094077 13078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.252:36671 every 8 connection(s)
I20260806 11:49:49.095065 12986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
I20260806 11:49:49.097489 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 12986
I20260806 11:49:49.097682 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786016786541679-27315-0/minicluster-data/master-2/wal/instance
I20260806 11:49:49.098073 27315 external_mini_cluster.cc:1428] Setting key 44060677d7fbd7e10b6ecb8b2bb7d635
I20260806 11:49:49.099625 13079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:49.104875 13079 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:49:49 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
Aug 06 11:49:49 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016989, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:49.116094 13082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.100054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48660 (local address 127.26.172.252:36671)
0806 11:49:49.100736 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.100758 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.100816 (+ 58us) server_negotiation.cc:407] Connection header received
0806 11:49:49.101606 (+ 790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.101629 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.102101 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.102519 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.103454 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.104632 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.105644 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.106211 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.106414 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.110077 (+ 3663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.110084 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.110095 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.110131 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.112298 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.112818 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.112823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.112828 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.112964 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.113272 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.113282 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.113284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.113744 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.113982 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.114456 (+ 474us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.114884 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":212,"threads_started":1}
I20260806 11:49:49.120268 13083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.107239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:42513 (local address 127.0.0.1:47354)
0806 11:49:49.107809 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:49.107861 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:49.108066 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:49.108455 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:49.108462 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:49.109125 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:49.109365 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:49.109377 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.110267 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.110269 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:49.111274 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:49.111289 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.111803 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.111807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:49.111940 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.112565 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:49.112578 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:49.114260 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:49.117221 (+ 2961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:49.117231 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:49.117238 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:49.117625 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:49.118084 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:49.118087 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:49.118089 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:49.118200 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:49.118894 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:49.118906 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:49.119466 (+ 560us) client_negotiation.cc:769] Sending connection context
0806 11:49:49.119650 (+ 184us) client_negotiation.cc:240] Negotiation successful
0806 11:49:49.119974 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":202,"threads_started":1}
I20260806 11:49:49.120393 12890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.107346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47354 (local address 127.26.172.254:42513)
0806 11:49:49.107577 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.107584 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.107974 (+ 390us) server_negotiation.cc:407] Connection header received
0806 11:49:49.108224 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.108227 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.108280 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.108381 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.109535 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.110121 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.111428 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.111663 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.111794 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.114459 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.114464 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.114468 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.114503 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.117077 (+ 2574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.117802 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.117808 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.117810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.117921 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.118392 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.118395 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.118397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.118687 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.118808 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.119744 (+ 936us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.120212 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 11:49:49.121980 13079 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:49:49 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
Aug 06 11:49:49 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016989, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
I20260806 11:49:49.132194 13084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.119902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47370 (local address 127.26.172.254:42513)
0806 11:49:49.120262 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.120276 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.120292 (+ 16us) server_negotiation.cc:407] Connection header received
0806 11:49:49.120330 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.120334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.120382 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.120485 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.121486 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.122390 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.123555 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.124054 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.124150 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.127542 (+ 3392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.127546 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.127548 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.127579 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.129542 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.130249 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.130256 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.130262 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.130390 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.130918 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.130923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.130925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.131235 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.131530 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.131719 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.131874 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":133,"threads_started":1}
I20260806 11:49:49.134200 13083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.122662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:36017 (local address 127.0.0.1:52540)
0806 11:49:49.122879 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:49.122900 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:49.123001 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:49.123407 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:49.123410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:49.123663 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:49.123825 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:49.123837 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.124868 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.124872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:49.125551 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:49.125561 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.126167 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.126172 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:49.126293 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.127516 (+ 1223us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:49.127530 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:49.129087 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:49.131782 (+ 2695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:49.131786 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:49.131788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:49.132070 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:49.132620 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:49.132623 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:49.132626 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:49.132736 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:49.133408 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:49.133412 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:49.133613 (+ 201us) client_negotiation.cc:769] Sending connection context
0806 11:49:49.133759 (+ 146us) client_negotiation.cc:240] Negotiation successful
0806 11:49:49.133983 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 11:49:49.134251 12985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.122954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.26.172.253:36017)
0806 11:49:49.123155 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.123160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.123179 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:49:49.123224 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.123227 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.123271 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.123366 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.123994 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.124696 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.125705 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.126015 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.126118 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.129282 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.129291 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.129296 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.129335 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.131613 (+ 2278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.132312 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.132318 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.132322 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.132444 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.132879 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.132886 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.132892 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.133227 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.133354 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.133852 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.134011 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 11:49:49.135592 13079 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:49:49 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
Aug 06 11:49:49 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016989, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
I20260806 11:49:49.145309 13083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.136313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48668)
0806 11:49:49.136453 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:49.136470 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:49.136555 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:49.136805 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:49.136807 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:49.136968 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:49.137071 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:49.137075 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.137920 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.137923 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:49.138501 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:49.138509 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.139266 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.139270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:49.139335 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.139841 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:49.139858 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:49.141364 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:49.143384 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:49.143388 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:49.143392 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:49.143649 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:49.144055 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:49.144058 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:49.144060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:49.144179 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:49.144623 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:49.144624 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:49.144679 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 11:49:49.144835 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 11:49:49.145050 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 11:49:49.145378 13082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.136402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48668 (local address 127.26.172.252:36671)
0806 11:49:49.136550 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.136554 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.136569 (+ 15us) server_negotiation.cc:407] Connection header received
0806 11:49:49.136629 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.136632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.136691 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.136773 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.137206 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.137817 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.138639 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.139105 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.139245 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.141529 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.141534 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.141538 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.141567 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.143246 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.143785 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.143790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.143792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.143911 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.144297 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.144301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.144303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.144513 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.144576 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.144902 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.145157 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":66}
I20260806 11:49:49.146113 12985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.133913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52556 (local address 127.26.172.253:36017)
0806 11:49:49.134539 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.134543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.134617 (+ 74us) server_negotiation.cc:407] Connection header received
0806 11:49:49.134667 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.134669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.134710 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.134855 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.135823 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.136394 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.137370 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.137675 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.137770 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.141200 (+ 3430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.141203 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.141205 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.141234 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.143265 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.143791 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.143795 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.143797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.143911 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.144316 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.144320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.144322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.144651 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.145009 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.145113 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.145249 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":176,"threads_started":1}
I20260806 11:49:49.149809 13079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399: Bootstrap starting.
I20260806 11:49:49.150697 12886 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } attempt: 3
I20260806 11:49:49.152025 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:49:49.153612 13079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:49.154788 13079 log.cc:824] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399: Log is configured to *not* fsync() on all Append() calls
Aug 06 11:49:49 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
I20260806 11:49:49.159688 13079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399: No bootstrap required, opened a new log
I20260806 11:49:49.165834 13084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.154891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47376 (local address 127.26.172.254:42513)
0806 11:49:49.155051 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.155059 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.155697 (+ 638us) server_negotiation.cc:407] Connection header received
0806 11:49:49.155864 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.155868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.155921 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.155997 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.156883 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.157549 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.158727 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.159105 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.159203 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.161394 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.161399 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.161403 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.161448 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.163688 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.164188 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.164193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.164195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.164288 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.164615 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.164619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.164620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.164886 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.165026 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.165480 (+ 454us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.165642 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 11:49:49.167914 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.151319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48676)
0806 11:49:49.151575 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:49.151593 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:49.151716 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:49.152160 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:49.152164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:49.152395 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:49.152534 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:49.152540 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.153641 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.153647 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:49.154436 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:49.154450 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.155305 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.155310 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:49.155425 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.156065 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:49.156081 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:49.163351 (+ 7270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:49.166087 (+ 2736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:49.166092 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:49.166094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:49.166386 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:49.166704 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:49.166707 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:49.166709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:49.166793 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:49.167286 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:49.167290 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:49.167408 (+ 118us) client_negotiation.cc:769] Sending connection context
0806 11:49:49.167504 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 11:49:49.167688 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151}
I20260806 11:49:49.168253 13090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.154891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48678 (local address 127.26.172.252:36671)
0806 11:49:49.157001 (+ 2110us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.157010 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.157026 (+ 16us) server_negotiation.cc:407] Connection header received
0806 11:49:49.157064 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.157066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.157112 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.157239 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.158115 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.159048 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.160304 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.160690 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.160814 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.162956 (+ 2142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.162960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.162964 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.162995 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.165181 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.165790 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.165794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.165796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.165897 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.166645 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.166651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.166655 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.166971 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.167106 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.167891 (+ 785us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.168044 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2022,"thread_start_us":122,"threads_started":1}
I20260806 11:49:49.168572 13082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.151405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48676 (local address 127.26.172.252:36671)
0806 11:49:49.151886 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.151892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.151906 (+ 14us) server_negotiation.cc:407] Connection header received
0806 11:49:49.151946 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.151949 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.151998 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.152082 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.152701 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.153465 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.154570 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.154975 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.155090 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.163563 (+ 8473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.163568 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.163571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.163603 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.165937 (+ 2334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.166505 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.166509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.166511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.166595 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.166949 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.166952 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.166954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.167156 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.167240 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.168300 (+ 1060us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.168429 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391}
I20260806 11:49:49.169421 12985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.156175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52570 (local address 127.26.172.253:36017)
0806 11:49:49.156324 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.156328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.156733 (+ 405us) server_negotiation.cc:407] Connection header received
0806 11:49:49.157906 (+ 1173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.157910 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.157973 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.158029 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.159238 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.160170 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.161353 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.161681 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.161764 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.163764 (+ 2000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.163770 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.163773 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.163806 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.166189 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.166937 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.166941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.166942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.167037 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.167361 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.167365 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.167366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.167620 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.167761 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.168834 (+ 1073us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.169158 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 11:49:49.170790 13079 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } }
I20260806 11:49:49.171169 13079 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:49.171216 13079 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbba4dcaa738437496b63a3455d88399, State: Initialized, Role: FOLLOWER
I20260806 11:49:49.171803 13079 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } }
I20260806 11:49:49.172405 12886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90: Bootstrap starting.
I20260806 11:49:49.172610 13095 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } } }
I20260806 11:49:49.172848 13095 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:49:49.173676 13079 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:49:49.175490 12886 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:49.176898 12886 log.cc:824] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:49.180016 12886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90: No bootstrap required, opened a new log
W20260806 11:49:49.180562 13111 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:49:49.180727 13111 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:49:49.178507 12986 master_runner.cc:186] Error getting master registration for 127.26.172.254:42513: OK, instance_id { permanent_uuid: "070367af594d473796c064627650dd90" instance_seqno: 1786016988499150 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 11:49:49.183158 12986 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 11:49:49.184734 12886 raft_consensus.cc:348] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } }
I20260806 11:49:49.185048 12886 raft_consensus.cc:374] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:49.185104 12886 raft_consensus.cc:729] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 070367af594d473796c064627650dd90, State: Initialized, Role: FOLLOWER
I20260806 11:49:49.185674 12886 consensus_queue.cc:260] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } }
I20260806 11:49:49.186478 13115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } } }
I20260806 11:49:49.186715 13115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:49:49.187489 12886 sys_catalog.cc:564] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 11:49:49.195046 13131 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:49:49.195179 13131 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:49:49.194350 12795 master_runner.cc:186] Error getting master registration for 127.26.172.253:36017: OK, instance_id { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" instance_seqno: 1786016988799241 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 11:49:49.198544 12795 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 11:49:49.218878 12979 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } attempt: 4
Aug 06 11:49:49 dist-test-slave-7z32 krb5kdc[12780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016988, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
I20260806 11:49:49.233554 12983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.219756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:36671 (local address 127.0.0.1:48680)
0806 11:49:49.220076 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:49.220095 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:49.220237 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:49.220666 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:49.220669 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:49.220953 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:49.221104 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:49.221112 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.222555 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.222561 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:49.223617 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:49.223632 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.225284 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.225288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:49.225405 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.226203 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:49.226221 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:49.228437 (+ 2216us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:49.231279 (+ 2842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:49.231285 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:49.231287 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:49.231657 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:49.232064 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:49.232068 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:49.232070 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:49.232186 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:49.232721 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:49.232725 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:49.232918 (+ 193us) client_negotiation.cc:769] Sending connection context
0806 11:49:49.233067 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 11:49:49.233319 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207}
I20260806 11:49:49.234277 13090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:49.219917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48680 (local address 127.26.172.252:36671)
0806 11:49:49.220108 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:49.220112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:49.220202 (+ 90us) server_negotiation.cc:407] Connection header received
0806 11:49:49.220374 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:49.220378 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:49.220455 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:49.220612 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:49.221294 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.222351 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.224616 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:49.225095 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:49.225249 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:49.228683 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:49.228690 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:49.228695 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:49.228742 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:49.231077 (+ 2335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.231804 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.231809 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.231811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.231935 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:49.232306 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:49.232310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:49.232312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:49.232595 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:49.232715 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:49.233907 (+ 1192us) server_negotiation.cc:299] Negotiation successful
0806 11:49:49.234087 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 11:49:49.240978 12979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903: Bootstrap starting.
I20260806 11:49:49.245252 12979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903: Neither blocks nor log segments found. Creating new log.
W20260806 11:49:49.245340 12823 tablet.cc:2369] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:49:49.246430 12979 log.cc:824] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:49.249580 12979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903: No bootstrap required, opened a new log
I20260806 11:49:49.255467 12979 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } }
I20260806 11:49:49.255829 12979 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:49.255904 12979 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d9ca1acfe44da69f8d4631b283f903, State: Initialized, Role: FOLLOWER
I20260806 11:49:49.256521 12979 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } }
I20260806 11:49:49.257303 13134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } } }
I20260806 11:49:49.257628 13134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:49:49.258484 12979 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:49:49.270617 12895 master_runner.cc:263] No leader master found from master 25d9ca1acfe44da69f8d4631b283f903
I20260806 11:49:49.270761 12895 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 11:49:49.271296 13149 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:49:49.271512 13149 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260806 11:49:49.294337 12920 tablet.cc:2369] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:49:49.337108 13015 tablet.cc:2369] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:49:49.429764 13115 raft_consensus.cc:482] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:49:49.430104 13115 raft_consensus.cc:504] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } }
I20260806 11:49:49.431547 13115 leader_election.cc:288] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d9ca1acfe44da69f8d4631b283f903 (127.26.172.253:36017), fbba4dcaa738437496b63a3455d88399 (127.26.172.252:36671)
I20260806 11:49:49.432423 13045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "070367af594d473796c064627650dd90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbba4dcaa738437496b63a3455d88399" is_pre_election: true
I20260806 11:49:49.432493 12944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "070367af594d473796c064627650dd90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d9ca1acfe44da69f8d4631b283f903" is_pre_election: true
I20260806 11:49:49.432873 13045 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 070367af594d473796c064627650dd90 in term 0.
I20260806 11:49:49.432976 12944 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 070367af594d473796c064627650dd90 in term 0.
I20260806 11:49:49.433578 12818 leader_election.cc:302] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 070367af594d473796c064627650dd90, 25d9ca1acfe44da69f8d4631b283f903, fbba4dcaa738437496b63a3455d88399; no voters:
I20260806 11:49:49.433981 13115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:49:49.434091 13115 raft_consensus.cc:482] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:49:49.434145 13115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:49.435716 13115 raft_consensus.cc:504] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } }
I20260806 11:49:49.436175 13115 leader_election.cc:288] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [CANDIDATE]: Term 1 election: Requested vote from peers 25d9ca1acfe44da69f8d4631b283f903 (127.26.172.253:36017), fbba4dcaa738437496b63a3455d88399 (127.26.172.252:36671)
I20260806 11:49:49.436674 13045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "070367af594d473796c064627650dd90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbba4dcaa738437496b63a3455d88399"
I20260806 11:49:49.436812 12944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "070367af594d473796c064627650dd90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d9ca1acfe44da69f8d4631b283f903"
I20260806 11:49:49.436854 13045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:49.436986 12944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:49.438642 12944 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 070367af594d473796c064627650dd90 in term 1.
I20260806 11:49:49.438642 13045 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 070367af594d473796c064627650dd90 in term 1.
I20260806 11:49:49.439366 12818 leader_election.cc:302] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 070367af594d473796c064627650dd90, fbba4dcaa738437496b63a3455d88399; no voters:
I20260806 11:49:49.439590 13115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:49:49.439890 13115 raft_consensus.cc:686] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [term 1 LEADER]: Becoming Leader. State: Replica: 070367af594d473796c064627650dd90, State: Running, Role: LEADER
I20260806 11:49:49.440382 13115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } }
I20260806 11:49:49.443493 13151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 070367af594d473796c064627650dd90. Latest consensus state: current_term: 1 leader_uuid: "070367af594d473796c064627650dd90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } } }
I20260806 11:49:49.443677 13151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:49.444468 13153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:49:49.446027 13153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:49:49.452876 12944 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [term 1 FOLLOWER]: Refusing update from remote peer 070367af594d473796c064627650dd90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:49:49.452980 13045 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [term 1 FOLLOWER]: Refusing update from remote peer 070367af594d473796c064627650dd90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:49:49.453867 13115 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:49:49.454210 13151 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:49:49.460628 13134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 070367af594d473796c064627650dd90. Latest consensus state: current_term: 1 leader_uuid: "070367af594d473796c064627650dd90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } } }
I20260806 11:49:49.460628 13095 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 070367af594d473796c064627650dd90. Latest consensus state: current_term: 1 leader_uuid: "070367af594d473796c064627650dd90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } } }
I20260806 11:49:49.460858 13095 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:49:49.460858 13134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:49:49.465197 13155 mvcc.cc:205] Tried to move back new op lower bound from 7315525588789309440 to 7315525588751081472. Current Snapshot: MvccSnapshot[applied={T|T < 7315525588789309440}]
I20260806 11:49:49.465137 13151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "070367af594d473796c064627650dd90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } } }
I20260806 11:49:49.465402 13151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:49.467689 13115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "070367af594d473796c064627650dd90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } } }
I20260806 11:49:49.467857 13115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90 [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:49.468430 13134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "070367af594d473796c064627650dd90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } } }
I20260806 11:49:49.468588 13134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:49:49.469156 13095 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "070367af594d473796c064627650dd90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "070367af594d473796c064627650dd90" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 42513 } } peers { permanent_uuid: "25d9ca1acfe44da69f8d4631b283f903" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 36017 } } peers { permanent_uuid: "fbba4dcaa738437496b63a3455d88399" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 36671 } } }
I20260806 11:49:49.469308 13095 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:49:49.470041 13153 catalog_manager.cc:1347] Generated new cluster ID: b49c3f29f90b44619452e44d363171a8
I20260806 11:49:49.470122 13153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:49:49.489643 13153 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:49:49.491184 13153 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:49:49.510550 13153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 070367af594d473796c064627650dd90: Generated new TSK 0
I20260806 11:49:49.511993 13153 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:49:50.182767 13111 catalog_manager.cc:1259] Loaded cluster ID: b49c3f29f90b44619452e44d363171a8
I20260806 11:49:50.182998 13111 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399: loading cluster ID for follower catalog manager: success
I20260806 11:49:50.185329 13111 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399: acquiring CA information for follower catalog manager: success
I20260806 11:49:50.187083 13111 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fbba4dcaa738437496b63a3455d88399: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 11:49:50.273645 13149 catalog_manager.cc:1259] Loaded cluster ID: b49c3f29f90b44619452e44d363171a8
I20260806 11:49:50.273775 13149 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903: loading cluster ID for follower catalog manager: success
I20260806 11:49:50.276345 13149 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903: acquiring CA information for follower catalog manager: success
I20260806 11:49:50.278127 13149 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 25d9ca1acfe44da69f8d4631b283f903: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 11:49:50.585408 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 12795
I20260806 11:49:50.605345 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 12895
I20260806 11:49:50.619598 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 12986
2026-08-06T11:49:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3845 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:49:50 dist-test-slave-7z32 krb5kdc[13172](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:49:50 dist-test-slave-7z32 krb5kdc[13172](info): set up 2 sockets
Aug 06 11:49:50 dist-test-slave-7z32 krb5kdc[13172](info): commencing operation
krb5kdc: starting...
W20260806 11:49:51.965996 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.315s user 0.005s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:49:52 dist-test-slave-7z32 krb5kdc[13172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:49:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:49:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:49:52.139221 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40487
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:33235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:40487
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:52.270275 13190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:52.270653 13190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:52.270702 13190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:52.275350 13190 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:49:52.275447 13190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:52.275467 13190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:52.275485 13190 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:49:52.275502 13190 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:49:52.281539 13190 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:33235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:40487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:52.283160 13190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:52.284433 13190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:52.295488 13197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:52.295488 13198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:52.295529 13200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:52.295758 13190 server_base.cc:1034] running on GCE node
I20260806 11:49:52.296909 13190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:52.298960 13190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:52.300203 13190 hybrid_clock.cc:648] HybridClock initialized: now 1786016992300156 us; error 79 us; skew 500 ppm
Aug 06 11:49:52 dist-test-slave-7z32 krb5kdc[13172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016992, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:52.309443 13190 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:49:52.311014 13190 webserver.cc:460] Webserver started at http://127.26.172.254:39709/ using document root <none> and password file <none>
I20260806 11:49:52.311823 13190 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:52.311904 13190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:52.312172 13190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:49:52.315053 13190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "ee52803c466b4c2c901a616ca2a99aa6"
format_stamp: "Formatted at 2026-08-06 11:49:52 on dist-test-slave-7z32"
server_key: "6e86a273ff03263197f6115fb246fdf2"
server_key_iv: "772c907cbb96fa23862f1b0c62259449"
server_key_version: "encryptionkey@0"
I20260806 11:49:52.315757 13190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "ee52803c466b4c2c901a616ca2a99aa6"
format_stamp: "Formatted at 2026-08-06 11:49:52 on dist-test-slave-7z32"
server_key: "6e86a273ff03263197f6115fb246fdf2"
server_key_iv: "772c907cbb96fa23862f1b0c62259449"
server_key_version: "encryptionkey@0"
I20260806 11:49:52.321030 13190 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:49:52.324632 13209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:52.326448 13190 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:49:52.326623 13190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "ee52803c466b4c2c901a616ca2a99aa6"
format_stamp: "Formatted at 2026-08-06 11:49:52 on dist-test-slave-7z32"
server_key: "6e86a273ff03263197f6115fb246fdf2"
server_key_iv: "772c907cbb96fa23862f1b0c62259449"
server_key_version: "encryptionkey@0"
I20260806 11:49:52.326877 13190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:52.347374 13190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:52.351821 13190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:52.352097 13190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:52.361948 13190 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:40487
I20260806 11:49:52.361977 13279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:40487 every 8 connection(s)
I20260806 11:49:52.363226 13190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:49:52.367094 13283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:52.371156 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 13190
I20260806 11:49:52.371313 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:49:52.371753 27315 external_mini_cluster.cc:1428] Setting key 44ac8859d5290c1bbddc3b75986cd7d8
I20260806 11:49:52.374363 13283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6: Bootstrap starting.
I20260806 11:49:52.377692 13283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:52.378643 13283 log.cc:824] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:52.381917 13283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6: No bootstrap required, opened a new log
Aug 06 11:49:52 dist-test-slave-7z32 krb5kdc[13172](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016992, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:52.386204 13283 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee52803c466b4c2c901a616ca2a99aa6" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40487 } }
I20260806 11:49:52.386544 13283 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:52.386657 13283 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee52803c466b4c2c901a616ca2a99aa6, State: Initialized, Role: FOLLOWER
I20260806 11:49:52.387298 13283 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee52803c466b4c2c901a616ca2a99aa6" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40487 } }
I20260806 11:49:52.387490 13283 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:49:52.387600 13283 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:49:52.387750 13283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:52.388938 13283 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee52803c466b4c2c901a616ca2a99aa6" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40487 } }
I20260806 11:49:52.389379 13283 leader_election.cc:302] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee52803c466b4c2c901a616ca2a99aa6; no voters:
I20260806 11:49:52.389830 13283 leader_election.cc:288] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:49:52.389973 13289 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:49:52.390283 13289 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [term 1 LEADER]: Becoming Leader. State: Replica: ee52803c466b4c2c901a616ca2a99aa6, State: Running, Role: LEADER
I20260806 11:49:52.390748 13289 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee52803c466b4c2c901a616ca2a99aa6" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40487 } }
I20260806 11:49:52.391623 13283 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:49:52.392102 13286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:52.373709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57646 (local address 127.26.172.254:40487)
0806 11:49:52.374299 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:52.374320 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:52.374370 (+ 50us) server_negotiation.cc:407] Connection header received
0806 11:49:52.375360 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:52.375386 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:52.375846 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:52.376244 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:52.377414 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:52.378717 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:52.380242 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:52.380886 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:52.381058 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:52.384687 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:52.384695 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:52.384719 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:52.384759 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:52.387764 (+ 3005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:52.388406 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:52.388414 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:52.388421 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:52.388570 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:52.388895 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:52.388899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:52.388901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:52.389600 (+ 699us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:52.389853 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:52.390285 (+ 432us) server_negotiation.cc:299] Negotiation successful
0806 11:49:52.390749 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":191,"threads_started":1}
I20260806 11:49:52.393074 13291 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee52803c466b4c2c901a616ca2a99aa6. Latest consensus state: current_term: 1 leader_uuid: "ee52803c466b4c2c901a616ca2a99aa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee52803c466b4c2c901a616ca2a99aa6" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40487 } } }
I20260806 11:49:52.393272 13291 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:52.393698 13290 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee52803c466b4c2c901a616ca2a99aa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee52803c466b4c2c901a616ca2a99aa6" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40487 } } }
I20260806 11:49:52.393961 13290 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6 [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:52.393826 13298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:49:52.396613 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:49:52.398442 13298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:49:52.406544 13298 catalog_manager.cc:1347] Generated new cluster ID: 8082e0a3e50346b0a5ecc051b5fdee3d
I20260806 11:49:52.406680 13298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:49:52.418788 13298 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:49:52.420473 13298 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:49:52.434218 13298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee52803c466b4c2c901a616ca2a99aa6: Generated new TSK 0
I20260806 11:49:52.435333 13298 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:49:52.455159 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 13190
2026-08-06T11:49:52Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1837 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:49:52 dist-test-slave-7z32 krb5kdc[13314](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:49:52 dist-test-slave-7z32 krb5kdc[13314](info): set up 2 sockets
Aug 06 11:49:52 dist-test-slave-7z32 krb5kdc[13314](info): commencing operation
krb5kdc: starting...
W20260806 11:49:53.749670 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.004s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:49:53 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:49:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:49:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:49:53.912057 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40475
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:40475
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:54.038278 13332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:54.038606 13332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:54.038650 13332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:54.042795 13332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:49:54.042971 13332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:54.042994 13332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:54.043012 13332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:49:54.043030 13332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:49:54.049304 13332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:40475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:54.050506 13332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:54.051635 13332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:54.061724 13344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:54.061892 13332 server_base.cc:1034] running on GCE node
W20260806 11:49:54.061777 13340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:54.061808 13339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:54.063050 13332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:54.064970 13332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:54.066186 13332 hybrid_clock.cc:648] HybridClock initialized: now 1786016994066146 us; error 68 us; skew 500 ppm
Aug 06 11:49:54 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016994, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:54.070446 13332 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:49:54.072221 13332 webserver.cc:460] Webserver started at http://127.26.172.254:41107/ using document root <none> and password file <none>
I20260806 11:49:54.073032 13332 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:54.073120 13332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:54.073405 13332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:49:54.076284 13332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "ac54bd625e0e4a349f28050b6bb9c8eb"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "a30fddd1ff6eb796aa4d1c2fbacbd93f"
server_key_iv: "4e44040739f3f03f905aa24d52542b79"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.077011 13332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "ac54bd625e0e4a349f28050b6bb9c8eb"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "a30fddd1ff6eb796aa4d1c2fbacbd93f"
server_key_iv: "4e44040739f3f03f905aa24d52542b79"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.082329 13332 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:49:54.086086 13353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:54.088146 13332 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:49:54.088352 13332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "ac54bd625e0e4a349f28050b6bb9c8eb"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "a30fddd1ff6eb796aa4d1c2fbacbd93f"
server_key_iv: "4e44040739f3f03f905aa24d52542b79"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.088521 13332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:54.118005 13332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:54.122628 13332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:54.122958 13332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:54.133286 13332 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:40475
I20260806 11:49:54.133694 13422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:40475 every 8 connection(s)
I20260806 11:49:54.134673 13332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:49:54.138249 13425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:54.143640 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 13332
I20260806 11:49:54.143796 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:49:54.144209 27315 external_mini_cluster.cc:1428] Setting key 8925f7fbd5449dbc8067360590e1f315
I20260806 11:49:54.145462 13425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Bootstrap starting.
I20260806 11:49:54.148383 13425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:54.149423 13425 log.cc:824] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:54.152406 13425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: No bootstrap required, opened a new log
Aug 06 11:49:54 dist-test-slave-7z32 krb5kdc[13314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016993, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:54.156980 13425 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:54.157351 13425 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:54.157437 13425 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac54bd625e0e4a349f28050b6bb9c8eb, State: Initialized, Role: FOLLOWER
I20260806 11:49:54.157994 13425 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:54.158182 13425 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:49:54.158304 13425 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:49:54.158435 13425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:54.159817 13425 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:54.160245 13425 leader_election.cc:302] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac54bd625e0e4a349f28050b6bb9c8eb; no voters:
I20260806 11:49:54.160684 13425 leader_election.cc:288] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:49:54.160770 13431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:49:54.161001 13431 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 1 LEADER]: Becoming Leader. State: Replica: ac54bd625e0e4a349f28050b6bb9c8eb, State: Running, Role: LEADER
I20260806 11:49:54.161430 13431 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:54.162269 13425 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:49:54.165338 13436 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac54bd625e0e4a349f28050b6bb9c8eb. Latest consensus state: current_term: 1 leader_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } } }
I20260806 11:49:54.165529 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:54.146400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43922 (local address 127.26.172.254:40475)
0806 11:49:54.147043 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:54.147064 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:54.147120 (+ 56us) server_negotiation.cc:407] Connection header received
0806 11:49:54.147992 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:54.148015 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:54.148504 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:54.148921 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:54.150043 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.151509 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.152814 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.153572 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.153761 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:54.157890 (+ 4129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:54.157916 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:54.157954 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:54.158020 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:54.160650 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:54.161506 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:54.161515 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:54.161524 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:54.161706 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:54.162077 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:54.162082 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:54.162084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:54.162782 (+ 698us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:54.163040 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:54.163806 (+ 766us) server_negotiation.cc:299] Negotiation successful
0806 11:49:54.164151 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":214,"threads_started":1}
I20260806 11:49:54.165570 13436 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:54.166975 13434 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } } }
I20260806 11:49:54.167207 13453 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:49:54.167344 13434 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:54.171015 13453 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:49:54.178691 13453 catalog_manager.cc:1347] Generated new cluster ID: d8142e495f4543618ed08f1ef1f0012c
I20260806 11:49:54.178857 13453 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:49:54.189293 13453 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:49:54.190412 13453 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:49:54.195726 13453 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Generated new TSK 0
I20260806 11:49:54.196483 13453 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:49:54.239431 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40475
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:54.367697 13461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:54.368060 13461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:54.368141 13461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:54.372589 13461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:54.372670 13461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:54.372733 13461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:49:54.379005 13461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:54.380138 13461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:54.381192 13461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:54.392613 13466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:54.392650 13469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:54.393000 13461 server_base.cc:1034] running on GCE node
W20260806 11:49:54.392839 13467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:54.393854 13461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:54.394701 13461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:54.395900 13461 hybrid_clock.cc:648] HybridClock initialized: now 1786016994395874 us; error 39 us; skew 500 ppm
Aug 06 11:49:54 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016994, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:54.399755 13461 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:49:54.401036 13461 webserver.cc:460] Webserver started at http://127.26.172.193:46743/ using document root <none> and password file <none>
I20260806 11:49:54.401733 13461 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:54.401811 13461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:54.402076 13461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:49:54.404538 13461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "8d06abea3a8347f4b9e4f2e4cff128da"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "5008106a870fba1ee9ab0d662d43d458"
server_key_iv: "7441fe6ba0b0afa011adaf5bda5f2d2d"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.405212 13461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "8d06abea3a8347f4b9e4f2e4cff128da"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "5008106a870fba1ee9ab0d662d43d458"
server_key_iv: "7441fe6ba0b0afa011adaf5bda5f2d2d"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.410785 13461 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:49:54.415113 13478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:54.417387 13461 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:49:54.417660 13461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "8d06abea3a8347f4b9e4f2e4cff128da"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "5008106a870fba1ee9ab0d662d43d458"
server_key_iv: "7441fe6ba0b0afa011adaf5bda5f2d2d"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.417868 13461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:54.436143 13461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:54.440034 13461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:54.440310 13461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:54.441119 13461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:54.442732 13461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:54.442813 13461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:54.442916 13461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:54.442956 13461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:54.456445 13461 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:33531
I20260806 11:49:54.456542 13642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:33531 every 8 connection(s)
I20260806 11:49:54.457842 13461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:49:54.460301 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 13461
I20260806 11:49:54.460549 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:49:54.460898 27315 external_mini_cluster.cc:1428] Setting key 7a223a40ad259034c381274c0769fe72
Aug 06 11:49:54 dist-test-slave-7z32 krb5kdc[13314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016994, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:49:54.476912 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:54.460593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:40601 (local address 127.26.172.254:40475)
0806 11:49:54.460775 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:54.460781 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:54.462320 (+ 1539us) server_negotiation.cc:407] Connection header received
0806 11:49:54.464351 (+ 2031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:54.464358 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:54.464458 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:54.464575 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:54.466329 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.467028 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.468425 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.468694 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.468836 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:54.472280 (+ 3444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:54.472284 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:54.472286 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:54.472314 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:54.473991 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:54.474680 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:54.474684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:54.474686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:54.474789 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:54.475363 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:54.475368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:54.475370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:54.475608 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:54.475732 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:54.476530 (+ 798us) server_negotiation.cc:299] Negotiation successful
0806 11:49:54.476700 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:49:54.478379 13647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:54.461271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:40601)
0806 11:49:54.462089 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:54.462179 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:54.464078 (+ 1899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:54.464832 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:54.464840 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:54.465277 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:54.466125 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:54.466150 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.467185 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.467189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:54.468288 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:54.468299 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.468916 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.468922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:54.469155 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:54.469976 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:54.469998 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:54.472034 (+ 2036us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:54.474185 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:54.474193 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:54.474218 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:54.474551 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:54.475052 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:54.475058 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:54.475064 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:54.475243 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:54.475733 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:54.475744 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:54.476202 (+ 458us) client_negotiation.cc:769] Sending connection context
0806 11:49:54.476483 (+ 281us) client_negotiation.cc:240] Negotiation successful
0806 11:49:54.476975 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":205,"threads_started":1}
I20260806 11:49:54.480336 13643 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40475
I20260806 11:49:54.480770 13643 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:54.481537 13643 heartbeater.cc:511] Master 127.26.172.254:40475 requested a full tablet report, sending...
I20260806 11:49:54.483872 13370 ts_manager.cc:194] Registered new tserver with Master: 8d06abea3a8347f4b9e4f2e4cff128da (127.26.172.193:33531)
I20260806 11:49:54.485461 13370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:40601
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:49:54.499023 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40475
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:54.625138 13650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:54.625452 13650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:54.625500 13650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:54.629853 13650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:54.629943 13650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:54.630004 13650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:49:54.635600 13650 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:54.636786 13650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:54.637943 13650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:54.649521 13658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:54.649540 13662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:54.649703 13650 server_base.cc:1034] running on GCE node
W20260806 11:49:54.649932 13659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:54.650494 13650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:54.651485 13650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:54.652729 13650 hybrid_clock.cc:648] HybridClock initialized: now 1786016994652693 us; error 64 us; skew 500 ppm
Aug 06 11:49:54 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016994, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:54.656210 13650 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:49:54.657352 13650 webserver.cc:460] Webserver started at http://127.26.172.194:39001/ using document root <none> and password file <none>
I20260806 11:49:54.658033 13650 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:54.658107 13650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:54.658313 13650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:49:54.660573 13650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "f73127f5a9024bf79ee0d14ddc144a4a"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "c47c80aa8cb24e9049099c075420799e"
server_key_iv: "57ae6c5e52fee120dddd21c55bd2c276"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.661123 13650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "f73127f5a9024bf79ee0d14ddc144a4a"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "c47c80aa8cb24e9049099c075420799e"
server_key_iv: "57ae6c5e52fee120dddd21c55bd2c276"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.666074 13650 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:49:54.669292 13671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:54.671420 13650 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:49:54.671620 13650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "f73127f5a9024bf79ee0d14ddc144a4a"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "c47c80aa8cb24e9049099c075420799e"
server_key_iv: "57ae6c5e52fee120dddd21c55bd2c276"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.671744 13650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:54.686024 13650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:54.689975 13650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:54.690164 13650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:54.690795 13650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:54.691884 13650 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:54.691937 13650 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:54.692013 13650 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:54.692054 13650 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:54.703758 13650 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:35307
I20260806 11:49:54.703819 13840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:35307 every 8 connection(s)
I20260806 11:49:54.704869 13650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:49:54.709023 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 13650
I20260806 11:49:54.709201 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:49:54.709656 27315 external_mini_cluster.cc:1428] Setting key ee56aa80a69864ba6323b62d7e0a53b4
Aug 06 11:49:54 dist-test-slave-7z32 krb5kdc[13314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016994, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:49:54.726027 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:54.707628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:34267 (local address 127.26.172.254:40475)
0806 11:49:54.707830 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:54.707835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:54.709063 (+ 1228us) server_negotiation.cc:407] Connection header received
0806 11:49:54.711561 (+ 2498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:54.711566 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:54.711632 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:54.711796 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:54.714086 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.714666 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.716520 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.716937 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.717085 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:54.721804 (+ 4719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:54.721808 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:54.721811 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:54.721851 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:54.723539 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:54.724164 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:54.724168 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:54.724169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:54.724259 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:54.724674 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:54.724678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:54.724680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:54.724898 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:54.725020 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:54.725685 (+ 665us) server_negotiation.cc:299] Negotiation successful
0806 11:49:54.725836 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 11:49:54.727218 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:54.708017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:34267)
0806 11:49:54.708749 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:54.708849 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:54.711250 (+ 2401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:54.712095 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:54.712108 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:54.712821 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:54.713843 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:54.713873 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.714889 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.714895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:54.716335 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:54.716348 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.717284 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.717293 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:54.717586 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:54.718500 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:54.718533 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:54.721556 (+ 3023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:54.723682 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:54.723690 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:54.723711 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:54.724043 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:54.724378 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:54.724381 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:54.724384 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:54.724558 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:54.725027 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:54.725038 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:54.725361 (+ 323us) client_negotiation.cc:769] Sending connection context
0806 11:49:54.725620 (+ 259us) client_negotiation.cc:240] Negotiation successful
0806 11:49:54.726048 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":126,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:49:54.728806 13841 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40475
I20260806 11:49:54.729307 13841 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:54.730075 13841 heartbeater.cc:511] Master 127.26.172.254:40475 requested a full tablet report, sending...
I20260806 11:49:54.731850 13370 ts_manager.cc:194] Registered new tserver with Master: f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307)
I20260806 11:49:54.733040 13370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:34267
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:49:54.750777 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40475
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:54.874993 13848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:54.875401 13848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:54.875496 13848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:54.879917 13848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:54.880033 13848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:54.880134 13848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:49:54.885721 13848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:40475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:54.887001 13848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:54.888219 13848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:54.900326 13854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:54.900339 13853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:54.900403 13856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:54.900648 13848 server_base.cc:1034] running on GCE node
I20260806 11:49:54.901288 13848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:54.902245 13848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:54.903493 13848 hybrid_clock.cc:648] HybridClock initialized: now 1786016994903457 us; error 53 us; skew 500 ppm
Aug 06 11:49:54 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016994, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:54.907280 13848 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:49:54.908591 13848 webserver.cc:460] Webserver started at http://127.26.172.195:41495/ using document root <none> and password file <none>
I20260806 11:49:54.909377 13848 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:54.909484 13848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:54.909795 13848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:49:54.912707 13848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "e7dfd162335a4a0bae7891291c9ccb1c"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "175c60683432d5acc6c0db50240acfa4"
server_key_iv: "8a04cf538a83e9dcade762b9b7b8880a"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.913504 13848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "e7dfd162335a4a0bae7891291c9ccb1c"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "175c60683432d5acc6c0db50240acfa4"
server_key_iv: "8a04cf538a83e9dcade762b9b7b8880a"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.919350 13848 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260806 11:49:54.923681 13864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:54.925634 13848 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:49:54.925868 13848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "e7dfd162335a4a0bae7891291c9ccb1c"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "175c60683432d5acc6c0db50240acfa4"
server_key_iv: "8a04cf538a83e9dcade762b9b7b8880a"
server_key_version: "encryptionkey@0"
I20260806 11:49:54.926051 13848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:54.964970 13848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:54.969911 13848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:54.970242 13848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:54.971261 13848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:54.972626 13848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:54.972714 13848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:54.972806 13848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:54.972857 13848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:54.988765 13848 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:37121
I20260806 11:49:54.988840 14026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:37121 every 8 connection(s)
I20260806 11:49:54.990391 13848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:49:54.992439 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 13848
I20260806 11:49:54.992673 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:49:54.993156 27315 external_mini_cluster.cc:1428] Setting key 3d764a421e18ff86eceaf17a0e20e58e
Aug 06 11:49:54 dist-test-slave-7z32 krb5kdc[13314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016994, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:55.008873 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:54.993255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:34999 (local address 127.26.172.254:40475)
0806 11:49:54.993506 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:54.993513 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:54.994665 (+ 1152us) server_negotiation.cc:407] Connection header received
0806 11:49:54.996526 (+ 1861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:54.996530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:54.996605 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:54.996695 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:54.998102 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.998675 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.999979 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.000230 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.000353 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.003755 (+ 3402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:55.003759 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:55.003762 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:55.003794 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:55.005765 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:55.006750 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:55.006754 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:55.006755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:55.006967 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:55.007522 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:55.007525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:55.007527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:55.007766 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:55.007887 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:55.008513 (+ 626us) server_negotiation.cc:299] Negotiation successful
0806 11:49:55.008688 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260806 11:49:55.009811 14029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:54.993749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:34999)
0806 11:49:54.994488 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:54.994548 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:54.996226 (+ 1678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:54.996902 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:54.996915 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:54.997375 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:54.997933 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:54.997948 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:54.998818 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:54.998878 (+ 60us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:54.999842 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:54.999852 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.000414 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.000418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.000610 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.001348 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:55.001373 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:55.003453 (+ 2080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:55.005987 (+ 2534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:55.005997 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:55.006025 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:55.006536 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:55.007134 (+ 598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:55.007138 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:55.007140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:55.007385 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:55.007911 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:55.007927 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:55.008226 (+ 299us) client_negotiation.cc:769] Sending connection context
0806 11:49:55.008447 (+ 221us) client_negotiation.cc:240] Negotiation successful
0806 11:49:55.008855 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":219,"threads_started":1}
I20260806 11:49:55.011763 14027 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40475
I20260806 11:49:55.012147 14027 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:55.012939 14027 heartbeater.cc:511] Master 127.26.172.254:40475 requested a full tablet report, sending...
I20260806 11:49:55.014724 13370 ts_manager.cc:194] Registered new tserver with Master: e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121)
I20260806 11:49:55.015769 13370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:34999
I20260806 11:49:55.022161 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:49:55.036038 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.025579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43938 (local address 127.26.172.254:40475)
0806 11:49:55.025796 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:55.025800 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:55.026117 (+ 317us) server_negotiation.cc:407] Connection header received
0806 11:49:55.026297 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:55.026300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:55.026363 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:55.026486 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:55.027624 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.028179 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.029189 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.029461 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.029565 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.031769 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:55.031773 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:55.031775 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:55.031807 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:55.033650 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:55.034370 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:55.034377 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:55.034379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:55.034514 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:55.034923 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:55.034926 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:55.034927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:55.035240 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:55.035363 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:55.035675 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 11:49:55.035804 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 11:49:55.040236 13370 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43938:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:49:55.043833 13370 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:49:55.062103 14046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.055944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:37121 (local address 127.0.0.1:54648)
0806 11:49:55.056952 (+ 1008us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:55.056967 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:55.057109 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:55.057662 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:55.057665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:55.057685 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:55.057792 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.057800 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.059491 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.059494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.060409 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.060419 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.061451 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.061460 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.061576 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.061615 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 11:49:55.061781 (+ 166us) client_negotiation.cc:240] Negotiation successful
0806 11:49:55.061936 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":929,"mutex_wait_us":706,"thread_start_us":109,"threads_started":1}
I20260806 11:49:55.062613 14045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.056236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54648 (local address 127.26.172.195:37121)
0806 11:49:55.056752 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:55.056763 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:55.057044 (+ 281us) server_negotiation.cc:407] Connection header received
0806 11:49:55.057289 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:55.057295 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:55.057504 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:55.057676 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:55.057895 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.059338 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.060549 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.061289 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.061432 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.061591 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:55.061863 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 11:49:55.062398 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":240,"threads_started":1}
I20260806 11:49:55.063544 14041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.054990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35307 (local address 127.0.0.1:45814)
0806 11:49:55.055832 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:55.055890 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:55.056036 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:55.056962 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:55.056966 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:55.057016 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:55.057315 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.057323 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.059299 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.059303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.060990 (+ 1687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.061004 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.063035 (+ 2031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.063039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.063147 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.063176 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 11:49:55.063268 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 11:49:55.063370 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"mutex_wait_us":183,"spinlock_wait_cycles":6144,"thread_start_us":140,"threads_started":1}
I20260806 11:49:55.063866 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.055173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45814 (local address 127.26.172.194:35307)
0806 11:49:55.056377 (+ 1204us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:55.056391 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:55.056419 (+ 28us) server_negotiation.cc:407] Connection header received
0806 11:49:55.056529 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:55.056536 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:55.056761 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:55.057484 (+ 723us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:55.057662 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.059149 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.061713 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.062633 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.062788 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.062957 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:55.063415 (+ 458us) server_negotiation.cc:299] Negotiation successful
0806 11:49:55.063673 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1089,"thread_start_us":137,"threads_started":1}
I20260806 11:49:55.064440 14042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.055153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:33531 (local address 127.0.0.1:39900)
0806 11:49:55.056036 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:55.056052 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:55.056219 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:55.056958 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:55.056966 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:55.057004 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:55.057342 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.057351 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.059104 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.059107 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.060990 (+ 1883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.061004 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.064001 (+ 2997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.064005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.064101 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.064126 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 11:49:55.064207 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 11:49:55.064293 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"mutex_wait_us":237,"spinlock_wait_cycles":6784,"thread_start_us":160,"threads_started":1}
I20260806 11:49:55.065065 14044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.055348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39900 (local address 127.26.172.193:33531)
0806 11:49:55.055857 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:55.055869 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:55.056344 (+ 475us) server_negotiation.cc:407] Connection header received
0806 11:49:55.056456 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:55.056468 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:55.056777 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:55.056961 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:55.057531 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.058945 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.061169 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.062011 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.062141 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.062276 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:55.064733 (+ 2457us) server_negotiation.cc:299] Negotiation successful
0806 11:49:55.064885 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":98,"threads_started":1}
I20260806 11:49:55.066972 13930 tablet_service.cc:1467] Processing CreateTablet for tablet 9fc1b0025ddc4eadb797db6bfc79a544 (DEFAULT_TABLE table=test-table [id=32c7dd5e8b0f427f8520fda197882339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:49:55.067741 13744 tablet_service.cc:1467] Processing CreateTablet for tablet 9fc1b0025ddc4eadb797db6bfc79a544 (DEFAULT_TABLE table=test-table [id=32c7dd5e8b0f427f8520fda197882339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:49:55.067960 13550 tablet_service.cc:1467] Processing CreateTablet for tablet 9fc1b0025ddc4eadb797db6bfc79a544 (DEFAULT_TABLE table=test-table [id=32c7dd5e8b0f427f8520fda197882339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:49:55.068785 13930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fc1b0025ddc4eadb797db6bfc79a544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:55.069172 13550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fc1b0025ddc4eadb797db6bfc79a544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:55.069172 13744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fc1b0025ddc4eadb797db6bfc79a544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:55.077818 14048 tablet_bootstrap.cc:492] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: Bootstrap starting.
I20260806 11:49:55.079778 14049 tablet_bootstrap.cc:492] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Bootstrap starting.
I20260806 11:49:55.080446 14051 tablet_bootstrap.cc:492] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: Bootstrap starting.
I20260806 11:49:55.081816 14048 tablet_bootstrap.cc:654] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:55.082371 14049 tablet_bootstrap.cc:654] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:55.082980 14048 log.cc:824] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:55.083370 14049 log.cc:824] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:55.083518 14051 tablet_bootstrap.cc:654] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:55.084410 14051 log.cc:824] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:55.085914 14048 tablet_bootstrap.cc:492] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: No bootstrap required, opened a new log
I20260806 11:49:55.086196 14048 ts_tablet_manager.cc:1397] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 11:49:55.086202 14049 tablet_bootstrap.cc:492] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: No bootstrap required, opened a new log
I20260806 11:49:55.086457 14049 ts_tablet_manager.cc:1397] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260806 11:49:55.086588 14051 tablet_bootstrap.cc:492] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: No bootstrap required, opened a new log
I20260806 11:49:55.086766 14051 ts_tablet_manager.cc:1397] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260806 11:49:55.090214 14048 raft_consensus.cc:348] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.090643 14048 raft_consensus.cc:374] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:55.090718 14048 raft_consensus.cc:729] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7dfd162335a4a0bae7891291c9ccb1c, State: Initialized, Role: FOLLOWER
I20260806 11:49:55.091291 14048 consensus_queue.cc:260] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.091765 14051 raft_consensus.cc:348] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.091765 14049 raft_consensus.cc:348] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.092096 14051 raft_consensus.cc:374] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:55.092096 14049 raft_consensus.cc:374] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:55.092146 14027 heartbeater.cc:503] Master 127.26.172.254:40475 was elected leader, sending a full tablet report...
I20260806 11:49:55.092161 14051 raft_consensus.cc:729] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f73127f5a9024bf79ee0d14ddc144a4a, State: Initialized, Role: FOLLOWER
I20260806 11:49:55.092162 14049 raft_consensus.cc:729] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d06abea3a8347f4b9e4f2e4cff128da, State: Initialized, Role: FOLLOWER
I20260806 11:49:55.092583 14048 ts_tablet_manager.cc:1428] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 11:49:55.092741 14049 consensus_queue.cc:260] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.092798 14051 consensus_queue.cc:260] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.093688 13841 heartbeater.cc:503] Master 127.26.172.254:40475 was elected leader, sending a full tablet report...
I20260806 11:49:55.093995 13643 heartbeater.cc:503] Master 127.26.172.254:40475 was elected leader, sending a full tablet report...
I20260806 11:49:55.094024 14051 ts_tablet_manager.cc:1428] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 11:49:55.094682 14049 ts_tablet_manager.cc:1428] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
W20260806 11:49:55.206416 13842 tablet.cc:2369] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:49:55.209785 13646 tablet.cc:2369] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:49:55.241962 14028 tablet.cc:2369] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:49:55.251427 14056 raft_consensus.cc:482] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:49:55.251653 14056 raft_consensus.cc:504] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.252921 14056 leader_election.cc:288] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307), 8d06abea3a8347f4b9e4f2e4cff128da (127.26.172.193:33531)
I20260806 11:49:55.259277 14029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.253412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35307 (local address 127.26.172.195:47047)
0806 11:49:55.253669 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:55.253686 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:55.253865 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:55.254379 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:55.254382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:55.254399 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:55.254628 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.254636 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.255941 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.255946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.257554 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.257560 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.258620 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.258625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.258809 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.258850 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 11:49:55.258944 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 11:49:55.259069 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":265}
I20260806 11:49:55.259263 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.253494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:47047 (local address 127.26.172.194:35307)
0806 11:49:55.253644 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:55.253649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:55.253770 (+ 121us) server_negotiation.cc:407] Connection header received
0806 11:49:55.254131 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:55.254139 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:55.254236 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:55.254345 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:55.254781 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.255762 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.257743 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.258442 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.258609 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.258680 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:55.258987 (+ 307us) server_negotiation.cc:299] Negotiation successful
0806 11:49:55.259083 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 11:49:55.259263 14044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.253504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:53355 (local address 127.26.172.193:33531)
0806 11:49:55.253799 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:55.253806 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:55.254203 (+ 397us) server_negotiation.cc:407] Connection header received
0806 11:49:55.254284 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:55.254290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:55.254360 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:55.254443 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:55.254783 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.255762 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.257743 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.258465 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.258608 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.258680 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:55.258987 (+ 307us) server_negotiation.cc:299] Negotiation successful
0806 11:49:55.259119 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260806 11:49:55.259600 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.253412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:33531 (local address 127.26.172.195:53355)
0806 11:49:55.254017 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:55.254031 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:55.254127 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:55.254464 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:55.254467 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:55.254481 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:55.254642 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.254647 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.255941 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.255946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.257546 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.257560 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.258620 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.258625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.258772 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.258848 (+ 76us) client_negotiation.cc:769] Sending connection context
0806 11:49:55.258944 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 11:49:55.259069 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":247,"thread_start_us":236,"threads_started":1}
I20260806 11:49:55.260380 13771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fc1b0025ddc4eadb797db6bfc79a544" candidate_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" is_pre_election: true
I20260806 11:49:55.260764 13771 raft_consensus.cc:2454] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7dfd162335a4a0bae7891291c9ccb1c in term 0.
I20260806 11:49:55.260910 13584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fc1b0025ddc4eadb797db6bfc79a544" candidate_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" is_pre_election: true
I20260806 11:49:55.261387 13584 raft_consensus.cc:2454] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7dfd162335a4a0bae7891291c9ccb1c in term 0.
I20260806 11:49:55.261590 13867 leader_election.cc:302] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7dfd162335a4a0bae7891291c9ccb1c, f73127f5a9024bf79ee0d14ddc144a4a; no voters:
I20260806 11:49:55.262020 14056 raft_consensus.cc:2781] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:49:55.262144 14056 raft_consensus.cc:482] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:49:55.262193 14056 raft_consensus.cc:3037] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:55.263610 14056 raft_consensus.cc:504] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.264048 14056 leader_election.cc:288] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [CANDIDATE]: Term 1 election: Requested vote from peers f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307), 8d06abea3a8347f4b9e4f2e4cff128da (127.26.172.193:33531)
I20260806 11:49:55.264673 13584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fc1b0025ddc4eadb797db6bfc79a544" candidate_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d06abea3a8347f4b9e4f2e4cff128da"
I20260806 11:49:55.264688 13771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fc1b0025ddc4eadb797db6bfc79a544" candidate_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f73127f5a9024bf79ee0d14ddc144a4a"
I20260806 11:49:55.264858 13584 raft_consensus.cc:3037] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:55.264915 13771 raft_consensus.cc:3037] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:55.266052 13584 raft_consensus.cc:2454] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7dfd162335a4a0bae7891291c9ccb1c in term 1.
I20260806 11:49:55.266396 13866 leader_election.cc:302] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d06abea3a8347f4b9e4f2e4cff128da, e7dfd162335a4a0bae7891291c9ccb1c; no voters:
I20260806 11:49:55.266469 13771 raft_consensus.cc:2454] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7dfd162335a4a0bae7891291c9ccb1c in term 1.
I20260806 11:49:55.266594 14056 raft_consensus.cc:2781] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:49:55.266912 14056 raft_consensus.cc:686] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 1 LEADER]: Becoming Leader. State: Replica: e7dfd162335a4a0bae7891291c9ccb1c, State: Running, Role: LEADER
I20260806 11:49:55.267323 14056 consensus_queue.cc:237] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.271168 13370 catalog_manager.cc:5495] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c reported cstate change: term changed from 0 to 1, leader changed from <none> to e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195). New cstate: current_term: 1 leader_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } health_report { overall_health: UNKNOWN } } }
I20260806 11:49:55.307623 14045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.302806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54650 (local address 127.26.172.195:37121)
0806 11:49:55.303001 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:55.303005 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:55.303023 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:49:55.303123 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:55.303125 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:55.303191 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:55.303301 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:49:55.303662 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.304234 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.305376 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.305599 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.305701 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.306121 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:49:55.306662 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:49:55.306802 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:55.307416 (+ 614us) server_negotiation.cc:299] Negotiation successful
0806 11:49:55.307491 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260806 11:49:55.316078 13584 raft_consensus.cc:1261] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Refusing update from remote peer e7dfd162335a4a0bae7891291c9ccb1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:49:55.316202 13771 raft_consensus.cc:1261] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a [term 1 FOLLOWER]: Refusing update from remote peer e7dfd162335a4a0bae7891291c9ccb1c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:49:55.317111 14060 consensus_queue.cc:1035] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:49:55.317440 14056 consensus_queue.cc:1035] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:49:55.326779 14065 mvcc.cc:205] Tried to move back new op lower bound from 7315525612803547136 to 7315525612617928704. Current Snapshot: MvccSnapshot[applied={T|T < 7315525612803547136}]
I20260806 11:49:55.327759 14066 mvcc.cc:205] Tried to move back new op lower bound from 7315525612803547136 to 7315525612617928704. Current Snapshot: MvccSnapshot[applied={T|T < 7315525612803547136}]
I20260806 11:49:55.338150 13374 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:49:55.338472 13374 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:49:55.342195 13374 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Sending DeleteTablet for 3 replicas of tablet 9fc1b0025ddc4eadb797db6bfc79a544
I20260806 11:49:55.343465 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 13461
I20260806 11:49:55.343470 13550 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc1b0025ddc4eadb797db6bfc79a544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:49:55 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:39900
I20260806 11:49:55.343796 13744 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc1b0025ddc4eadb797db6bfc79a544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:49:55 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:45814
I20260806 11:49:55.345896 13930 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc1b0025ddc4eadb797db6bfc79a544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:49:55 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:54648
I20260806 11:49:55.346561 14083 tablet_replica.cc:330] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: stopping tablet replica
I20260806 11:49:55.347002 14083 raft_consensus.cc:2229] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:49:55.347386 14083 raft_consensus.cc:2258] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:49:55.355466 14081 tablet_replica.cc:330] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: stopping tablet replica
I20260806 11:49:55.356115 14081 raft_consensus.cc:2229] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:49:55.356892 14081 raft_consensus.cc:2258] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:49:55.357777 14083 ts_tablet_manager.cc:1905] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:49:55.359486 14081 ts_tablet_manager.cc:1905] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:49:55.362289 14083 ts_tablet_manager.cc:1918] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:49:55.362542 14083 log.cc:1196] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/9fc1b0025ddc4eadb797db6bfc79a544
I20260806 11:49:55.363180 14081 ts_tablet_manager.cc:1918] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:49:55.363380 14081 log.cc:1196] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/9fc1b0025ddc4eadb797db6bfc79a544
I20260806 11:49:55.363261 14083 ts_tablet_manager.cc:1939] T 9fc1b0025ddc4eadb797db6bfc79a544 P e7dfd162335a4a0bae7891291c9ccb1c: Deleting consensus metadata
I20260806 11:49:55.363814 14081 ts_tablet_manager.cc:1939] T 9fc1b0025ddc4eadb797db6bfc79a544 P f73127f5a9024bf79ee0d14ddc144a4a: Deleting consensus metadata
W20260806 11:49:55.364764 13357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:33531 (error 108)
I20260806 11:49:55.365115 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 13650
I20260806 11:49:55.370255 14042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.366688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:33531 (local address 127.0.0.1:39908)
0806 11:49:55.369959 (+ 3271us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:55.370104 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:33531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3119}
I20260806 11:49:55.370554 13358 catalog_manager.cc:4841] TS e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121): tablet 9fc1b0025ddc4eadb797db6bfc79a544 (table test-table [id=32c7dd5e8b0f427f8520fda197882339]) successfully deleted
W20260806 11:49:55.375857 13357 catalog_manager.cc:4584] TS 8d06abea3a8347f4b9e4f2e4cff128da (127.26.172.193:33531): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9fc1b0025ddc4eadb797db6bfc79a544: Network error: Client connection negotiation failed: client connection to 127.26.172.193:33531: connect: Connection refused (error 111)
I20260806 11:49:55.391705 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 13848
I20260806 11:49:55.392238 14042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.391665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35307 (local address 127.0.0.1:45828)
0806 11:49:55.391946 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:55.392055 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.194:35307: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260806 11:49:55.406613 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 13332
I20260806 11:49:55.420498 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40475
--webserver_interface=127.26.172.254
--webserver_port=41107
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:40475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:55.545240 14087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:55.545562 14087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:55.545605 14087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:55.549961 14087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:49:55.550050 14087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:55.550069 14087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:55.550087 14087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:49:55.550102 14087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:49:55.555922 14087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:40475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=41107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:55.557158 14087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:55.558314 14087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:55.577875 14093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:55.578069 14097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:55.578024 14094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:55.578533 14087 server_base.cc:1034] running on GCE node
I20260806 11:49:55.579384 14087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:55.580852 14087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:55.582191 14087 hybrid_clock.cc:648] HybridClock initialized: now 1786016995582155 us; error 57 us; skew 500 ppm
Aug 06 11:49:55 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016995, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:55.586079 14087 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:49:55.587524 14087 webserver.cc:460] Webserver started at http://127.26.172.254:41107/ using document root <none> and password file <none>
I20260806 11:49:55.588205 14087 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:55.588296 14087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:55.593544 14087 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 11:49:55.596817 14106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:55.598783 14087 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 11:49:55.599066 14087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "ac54bd625e0e4a349f28050b6bb9c8eb"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "a30fddd1ff6eb796aa4d1c2fbacbd93f"
server_key_iv: "4e44040739f3f03f905aa24d52542b79"
server_key_version: "encryptionkey@0"
I20260806 11:49:55.599866 14087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:55.622620 14087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:55.627147 14087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:55.627413 14087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:55.636318 14087 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:40475
I20260806 11:49:55.636796 14184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:40475 every 8 connection(s)
I20260806 11:49:55.637686 14087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:49:55.642252 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 14087
I20260806 11:49:55.642930 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:33531
--local_ip_for_outbound_sockets=127.26.172.193
--tserver_master_addrs=127.26.172.254:40475
--webserver_port=46743
--webserver_interface=127.26.172.193
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:49:55.645131 14185 sys_catalog.cc:263] Verifying existing consensus state
I20260806 11:49:55.648144 14185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Bootstrap starting.
I20260806 11:49:55.673914 14185 log.cc:824] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:55.686058 14185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:49:55.686616 14185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Bootstrap complete.
I20260806 11:49:55.692919 14185 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:55.693615 14185 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac54bd625e0e4a349f28050b6bb9c8eb, State: Initialized, Role: FOLLOWER
I20260806 11:49:55.694324 14185 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:55.694512 14185 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:49:55.694634 14185 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:49:55.694794 14185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 1 FOLLOWER]: Advancing to term 2
I20260806 11:49:55.697911 14185 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:55.698487 14185 leader_election.cc:302] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac54bd625e0e4a349f28050b6bb9c8eb; no voters:
I20260806 11:49:55.699409 14185 leader_election.cc:288] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 11:49:55.699573 14191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 2 FOLLOWER]: Leader election won for term 2
I20260806 11:49:55.699824 14191 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 2 LEADER]: Becoming Leader. State: Replica: ac54bd625e0e4a349f28050b6bb9c8eb, State: Running, Role: LEADER
I20260806 11:49:55.700241 14191 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:55.701473 14185 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:49:55.702921 14193 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac54bd625e0e4a349f28050b6bb9c8eb. Latest consensus state: current_term: 2 leader_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } } }
I20260806 11:49:55.702934 14192 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } } }
I20260806 11:49:55.703138 14193 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:55.703228 14192 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:55.709143 14215 catalog_manager.cc:1259] Loaded cluster ID: d8142e495f4543618ed08f1ef1f0012c
I20260806 11:49:55.709259 14215 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: loading cluster ID for follower catalog manager: success
W20260806 11:49:55.710470 14215 catalog_manager.cc:1576] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260806 11:49:55.710568 14215 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260806 11:49:55.710664 14205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:49:55.713810 14205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:49:55.714416 14205 catalog_manager.cc:1259] Loaded cluster ID: d8142e495f4543618ed08f1ef1f0012c
I20260806 11:49:55.714495 14205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:49:55.716341 14205 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 11:49:55.721336 14205 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 11:49:55.729161 14205 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:49:55.730279 14205 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Loaded TSK: 0
I20260806 11:49:55.731961 14205 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 11:49:55.784827 14189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:55.785156 14189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:55.785202 14189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:55.789795 14189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:55.789894 14189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:55.789960 14189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:49:55.799657 14189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:33531
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=46743
--tserver_master_addrs=127.26.172.254:40475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:55.801383 14189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:55.803277 14189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:55.816948 14228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:55.816867 14226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:55.816857 14230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:55.817210 14189 server_base.cc:1034] running on GCE node
I20260806 11:49:55.818015 14189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:55.818866 14189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:55.820190 14189 hybrid_clock.cc:648] HybridClock initialized: now 1786016995820156 us; error 58 us; skew 500 ppm
Aug 06 11:49:55 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016995, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:55.823706 14189 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:49:55.825037 14189 webserver.cc:460] Webserver started at http://127.26.172.193:46743/ using document root <none> and password file <none>
I20260806 11:49:55.825721 14189 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:55.825810 14189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:55.830629 14189 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 11:49:55.833609 14239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:55.835703 14189 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:49:55.835898 14189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "8d06abea3a8347f4b9e4f2e4cff128da"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "5008106a870fba1ee9ab0d662d43d458"
server_key_iv: "7441fe6ba0b0afa011adaf5bda5f2d2d"
server_key_version: "encryptionkey@0"
I20260806 11:49:55.836648 14189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:55.858620 14189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:55.862242 14189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:55.862489 14189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:55.863288 14189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:55.864634 14248 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 11:49:55.869417 14189 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 11:49:55.869493 14189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260806 11:49:55.869547 14189 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 11:49:55.871474 14189 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 11:49:55.871541 14189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260806 11:49:55.871803 14248 tablet_bootstrap.cc:492] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Bootstrap starting.
I20260806 11:49:55.883989 14189 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:33531
I20260806 11:49:55.884615 14401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:33531 every 8 connection(s)
I20260806 11:49:55.885468 14189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:49:55.886735 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 14189
I20260806 11:49:55.887367 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:35307
--local_ip_for_outbound_sockets=127.26.172.194
--tserver_master_addrs=127.26.172.254:40475
--webserver_port=39001
--webserver_interface=127.26.172.194
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:49:55.896358 14248 log.cc:824] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Log is configured to *not* fsync() on all Append() calls
Aug 06 11:49:55 dist-test-slave-7z32 krb5kdc[13314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016995, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:55.907820 14248 tablet_bootstrap.cc:492] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:49:55.908432 14248 tablet_bootstrap.cc:492] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Bootstrap complete.
I20260806 11:49:55.910576 14248 ts_tablet_manager.cc:1397] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Time spent bootstrapping tablet: real 0.039s user 0.030s sys 0.004s
I20260806 11:49:55.913774 14405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.888913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:60695)
0806 11:49:55.890781 (+ 1868us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:55.890904 (+ 123us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:55.892400 (+ 1496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:55.894230 (+ 1830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:55.894240 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:55.894713 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:55.895505 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.895525 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.897898 (+ 2373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.897903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.899383 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.899398 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.900938 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.900943 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.901180 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.902102 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:55.902125 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:55.905143 (+ 3018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:55.908807 (+ 3664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:55.908818 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:55.908844 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:55.909402 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:55.910089 (+ 687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:55.910093 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:55.910096 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:55.910345 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:55.911337 (+ 992us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:55.911347 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:55.911795 (+ 448us) client_negotiation.cc:769] Sending connection context
0806 11:49:55.912058 (+ 263us) client_negotiation.cc:240] Negotiation successful
0806 11:49:55.912517 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1549,"thread_start_us":196,"threads_started":1}
I20260806 11:49:55.913823 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.889402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:60695 (local address 127.26.172.254:40475)
0806 11:49:55.890326 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:55.890356 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:55.891130 (+ 774us) server_negotiation.cc:407] Connection header received
0806 11:49:55.893042 (+ 1912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:55.893065 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:55.893605 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:55.894059 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:55.895782 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.897541 (+ 1759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.899583 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.900680 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.900982 (+ 302us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.905702 (+ 4720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:55.905712 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:55.905734 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:55.905789 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:55.908562 (+ 2773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:55.909701 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:55.909714 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:55.909724 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:55.909949 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:55.910502 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:55.910506 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:55.910508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:55.911173 (+ 665us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:55.911343 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:55.912257 (+ 914us) server_negotiation.cc:299] Negotiation successful
0806 11:49:55.912693 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":176,"threads_started":1}
I20260806 11:49:55.914361 14248 raft_consensus.cc:348] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.915012 14248 raft_consensus.cc:729] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d06abea3a8347f4b9e4f2e4cff128da, State: Initialized, Role: FOLLOWER
I20260806 11:49:55.915650 14248 consensus_queue.cc:260] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:55.916996 14248 ts_tablet_manager.cc:1428] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Time spent starting tablet: real 0.006s user 0.009s sys 0.000s
I20260806 11:49:55.917989 14403 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40475
I20260806 11:49:55.918349 14403 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:55.919135 14403 heartbeater.cc:511] Master 127.26.172.254:40475 requested a full tablet report, sending...
I20260806 11:49:55.923029 14129 ts_manager.cc:194] Registered new tserver with Master: 8d06abea3a8347f4b9e4f2e4cff128da (127.26.172.193:33531)
I20260806 11:49:55.927760 14129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:60695
I20260806 11:49:55.931676 14403 heartbeater.cc:503] Master 127.26.172.254:40475 was elected leader, sending a full tablet report...
Aug 06 11:49:55 dist-test-slave-7z32 krb5kdc[13314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016995, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:49:55.941587 14414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.927159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:33531 (local address 127.0.0.1:39914)
0806 11:49:55.928319 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:55.928381 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:55.928578 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:55.930242 (+ 1664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:55.930253 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:55.930708 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:55.930963 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.930974 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.932175 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.932182 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.932998 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:55.933011 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.933698 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.933702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:55.933837 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.934627 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:55.934644 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:55.936785 (+ 2141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:55.939298 (+ 2513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:55.939310 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:55.939319 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:55.939626 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:55.939988 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:55.939991 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:55.939994 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:55.940134 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:55.940709 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:55.940717 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:55.940880 (+ 163us) client_negotiation.cc:769] Sending connection context
0806 11:49:55.941050 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 11:49:55.941346 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":920,"thread_start_us":177,"threads_started":1}
I20260806 11:49:55.941634 14417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:55.927261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39914 (local address 127.26.172.193:33531)
0806 11:49:55.928799 (+ 1538us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:55.928818 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:55.928848 (+ 30us) server_negotiation.cc:407] Connection header received
0806 11:49:55.928944 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:55.928949 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:55.929238 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:55.929407 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:55.931124 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.932029 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.933143 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:55.933548 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:55.933695 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:55.936970 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:55.936981 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:55.936996 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:55.937024 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:55.939144 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:55.939784 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:55.939790 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:55.939792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:55.939885 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:55.940239 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:55.940242 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:55.940244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:55.940576 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:55.940743 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:55.941170 (+ 427us) server_negotiation.cc:299] Negotiation successful
0806 11:49:55.941465 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":168,"threads_started":1}
I20260806 11:49:55.943511 14308 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fc1b0025ddc4eadb797db6bfc79a544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:49:55 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:39914
I20260806 11:49:55.944803 14418 tablet_replica.cc:330] stopping tablet replica
I20260806 11:49:55.945243 14418 raft_consensus.cc:2229] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:49:55.945581 14418 raft_consensus.cc:2258] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:49:55.947012 14418 ts_tablet_manager.cc:1905] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:49:55.952466 14418 ts_tablet_manager.cc:1918] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:49:55.952605 14418 log.cc:1196] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/9fc1b0025ddc4eadb797db6bfc79a544
I20260806 11:49:55.952951 14418 ts_tablet_manager.cc:1939] T 9fc1b0025ddc4eadb797db6bfc79a544 P 8d06abea3a8347f4b9e4f2e4cff128da: Deleting consensus metadata
I20260806 11:49:55.955569 14108 catalog_manager.cc:4841] TS 8d06abea3a8347f4b9e4f2e4cff128da (127.26.172.193:33531): tablet 9fc1b0025ddc4eadb797db6bfc79a544 (table test-table [id=32c7dd5e8b0f427f8520fda197882339]) successfully deleted
W20260806 11:49:56.041188 14409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:56.041568 14409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:56.041646 14409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:56.046059 14409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:56.046164 14409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:56.046233 14409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:49:56.052708 14409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:35307
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=39001
--tserver_master_addrs=127.26.172.254:40475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:56.053977 14409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:56.055128 14409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:56.066514 14426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:56.066543 14424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:56.066555 14423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:56.067134 14409 server_base.cc:1034] running on GCE node
I20260806 11:49:56.067605 14409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:56.068342 14409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:56.071687 14409 hybrid_clock.cc:648] HybridClock initialized: now 1786016996071733 us; error 158 us; skew 500 ppm
Aug 06 11:49:56 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016996, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:56.075766 14409 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:49:56.077088 14409 webserver.cc:460] Webserver started at http://127.26.172.194:39001/ using document root <none> and password file <none>
I20260806 11:49:56.077832 14409 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:56.077975 14409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:56.083328 14409 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:49:56.086474 14440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:56.088522 14409 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:49:56.088814 14409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "f73127f5a9024bf79ee0d14ddc144a4a"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "c47c80aa8cb24e9049099c075420799e"
server_key_iv: "57ae6c5e52fee120dddd21c55bd2c276"
server_key_version: "encryptionkey@0"
I20260806 11:49:56.089624 14409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:56.105511 14409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:56.109903 14409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:56.110160 14409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:56.110962 14409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:56.111972 14409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:56.112057 14409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:56.112133 14409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:56.112186 14409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:56.125451 14409 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:35307
I20260806 11:49:56.125522 14598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:35307 every 8 connection(s)
I20260806 11:49:56.126719 14409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:49:56.133212 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 14409
I20260806 11:49:56.133747 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:37121
--local_ip_for_outbound_sockets=127.26.172.195
--tserver_master_addrs=127.26.172.254:40475
--webserver_port=41495
--webserver_interface=127.26.172.195
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:49:56 dist-test-slave-7z32 krb5kdc[13314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016996, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:56.148867 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.129465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:55369 (local address 127.26.172.254:40475)
0806 11:49:56.129649 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:56.129653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:56.130958 (+ 1305us) server_negotiation.cc:407] Connection header received
0806 11:49:56.132877 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:56.132882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:56.132985 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:56.133139 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:56.135253 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.136088 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.138406 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.138695 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.138792 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.143138 (+ 4346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:56.143142 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:56.143144 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:56.143190 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:56.144973 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:56.145983 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:56.145987 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:56.145989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:56.146093 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:56.146699 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:56.146703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:56.146704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:56.147045 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:56.147147 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:56.148549 (+ 1402us) server_negotiation.cc:299] Negotiation successful
0806 11:49:56.148716 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 11:49:56.150815 14602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.129843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:55369)
0806 11:49:56.130673 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:56.130757 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:56.132477 (+ 1720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:56.133486 (+ 1009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:56.133500 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:56.134180 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:56.135023 (+ 843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.135045 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.136293 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.136300 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.138131 (+ 1831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.138151 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.138948 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.138956 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.139285 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.140238 (+ 953us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:56.140272 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:56.142803 (+ 2531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:56.145159 (+ 2356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:56.145172 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:56.145205 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:56.145774 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:56.146227 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:56.146234 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:56.146239 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:56.146521 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:56.147194 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:56.147208 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:56.148101 (+ 893us) client_negotiation.cc:769] Sending connection context
0806 11:49:56.148441 (+ 340us) client_negotiation.cc:240] Negotiation successful
0806 11:49:56.149020 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":145,"threads_started":1}
I20260806 11:49:56.152909 14600 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40475
I20260806 11:49:56.153350 14600 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:56.154214 14600 heartbeater.cc:511] Master 127.26.172.254:40475 requested a full tablet report, sending...
I20260806 11:49:56.155903 14129 ts_manager.cc:194] Registered new tserver with Master: f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307)
I20260806 11:49:56.156620 14129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:55369
W20260806 11:49:56.287659 14603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:56.288070 14603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:56.288196 14603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:56.292816 14603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:56.292915 14603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:56.292987 14603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:49:56.299409 14603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:37121
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=41495
--tserver_master_addrs=127.26.172.254:40475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:56.300952 14603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:56.302349 14603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:56.315773 14610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:56.315778 14612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:56.315776 14615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:56.316147 14603 server_base.cc:1034] running on GCE node
I20260806 11:49:56.317039 14603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:56.317956 14603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:56.319250 14603 hybrid_clock.cc:648] HybridClock initialized: now 1786016996319229 us; error 46 us; skew 500 ppm
Aug 06 11:49:56 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016996, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:56.322949 14603 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:49:56.324433 14603 webserver.cc:460] Webserver started at http://127.26.172.195:41495/ using document root <none> and password file <none>
I20260806 11:49:56.325357 14603 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:56.325500 14603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:56.331123 14603 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:49:56.334215 14624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:56.336347 14603 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:49:56.336555 14603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "e7dfd162335a4a0bae7891291c9ccb1c"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "175c60683432d5acc6c0db50240acfa4"
server_key_iv: "8a04cf538a83e9dcade762b9b7b8880a"
server_key_version: "encryptionkey@0"
I20260806 11:49:56.337625 14603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:56.388253 14603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:56.392710 14603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:56.393014 14603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:56.393899 14603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:56.395105 14603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:56.395184 14603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:56.395256 14603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:56.395285 14603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:56.408988 14603 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:37121
I20260806 11:49:56.410373 14603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:49:56.411237 14778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:37121 every 8 connection(s)
I20260806 11:49:56.417291 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 14603
Aug 06 11:49:56 dist-test-slave-7z32 krb5kdc[13314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016996, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:49:56.430234 14782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.418810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43952 (local address 127.26.172.254:40475)
0806 11:49:56.419156 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:56.419161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:56.419326 (+ 165us) server_negotiation.cc:407] Connection header received
0806 11:49:56.419435 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:56.419438 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:56.419499 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:56.419641 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:56.420671 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.421518 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.422811 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.423275 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.423442 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.425461 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:56.425467 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:56.425470 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:56.425514 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:56.427982 (+ 2468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:56.428675 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:56.428678 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:56.428679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:56.428780 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:56.429109 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:56.429112 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:56.429113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:56.429309 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:56.429482 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:56.429864 (+ 382us) server_negotiation.cc:299] Negotiation successful
0806 11:49:56.430002 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":103,"threads_started":1}
I20260806 11:49:56.432001 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.413590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:51479 (local address 127.26.172.254:40475)
0806 11:49:56.413874 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:56.413880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:56.415331 (+ 1451us) server_negotiation.cc:407] Connection header received
0806 11:49:56.417574 (+ 2243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:56.417579 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:56.417667 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:56.417804 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:56.419901 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.420790 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.422283 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.422661 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.422785 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.426695 (+ 3910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:56.426699 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:56.426702 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:56.426762 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:56.428622 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:56.429512 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:56.429516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:56.429518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:56.429619 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:56.430113 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:56.430117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:56.430118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:56.430617 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:56.430696 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:56.431661 (+ 965us) server_negotiation.cc:299] Negotiation successful
0806 11:49:56.431875 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260806 11:49:56.433472 14781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.414255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:51479)
0806 11:49:56.415068 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:56.415147 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:56.417138 (+ 1991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:56.418199 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:56.418211 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:56.418877 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:56.419709 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.419732 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.420931 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.420934 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.422144 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.422154 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.422971 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.422975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.423227 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.424192 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:56.424210 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:56.426454 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:56.428803 (+ 2349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:56.428813 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:56.428843 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:56.429343 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:56.429745 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:56.429749 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:56.429751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:56.429983 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:56.430759 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:56.430765 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:56.431238 (+ 473us) client_negotiation.cc:769] Sending connection context
0806 11:49:56.431512 (+ 274us) client_negotiation.cc:240] Negotiation successful
0806 11:49:56.431996 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":207,"threads_started":1}
I20260806 11:49:56.435232 14779 heartbeater.cc:347] Connected to a master server at 127.26.172.254:40475
I20260806 11:49:56.435638 14779 heartbeater.cc:464] Registering TS with master...
I20260806 11:49:56.436362 14779 heartbeater.cc:511] Master 127.26.172.254:40475 requested a full tablet report, sending...
I20260806 11:49:56.437743 14129 ts_manager.cc:194] Registered new tserver with Master: e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121)
I20260806 11:49:56.438478 14129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:51479
I20260806 11:49:56.445657 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:49:56.451684 14406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.446538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43960 (local address 127.26.172.254:40475)
0806 11:49:56.446703 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:56.446707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:56.447103 (+ 396us) server_negotiation.cc:407] Connection header received
0806 11:49:56.447309 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:56.447311 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:56.447433 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:56.447588 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:49:56.447882 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.448503 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.449780 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.450043 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.450154 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.450579 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:49:56.451144 (+ 565us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:49:56.451268 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:56.451490 (+ 222us) server_negotiation.cc:299] Negotiation successful
0806 11:49:56.451553 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 11:49:56.452713 14129 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:43960:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:49:56.456564 14129 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:49:56.467175 14308 tablet_service.cc:1467] Processing CreateTablet for tablet 80f34734fb684a85b8deba21af1f39e8 (DEFAULT_TABLE table=test-table [id=12b0a6d7d97145eeb7fc218884a263d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:49:56.467950 14308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80f34734fb684a85b8deba21af1f39e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:56.471330 14798 tablet_bootstrap.cc:492] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: Bootstrap starting.
I20260806 11:49:56.472543 14798 tablet_bootstrap.cc:654] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:56.472987 14791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.466170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35307 (local address 127.0.0.1:45836)
0806 11:49:56.466512 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:56.466534 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:56.466731 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:56.467799 (+ 1068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:56.467803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:56.467839 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:56.467953 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.467960 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.469396 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.469402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.470875 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.470888 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.472306 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.472310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.472503 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.472618 (+ 115us) client_negotiation.cc:769] Sending connection context
0806 11:49:56.472685 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 11:49:56.472791 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":116,"thread_start_us":137,"threads_started":1}
I20260806 11:49:56.473824 14798 tablet_bootstrap.cc:492] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: No bootstrap required, opened a new log
I20260806 11:49:56.473906 14793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.466362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45836 (local address 127.26.172.194:35307)
0806 11:49:56.466966 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:56.466981 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:56.467012 (+ 31us) server_negotiation.cc:407] Connection header received
0806 11:49:56.467112 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:56.467118 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:56.467367 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:56.467556 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:56.468104 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.469222 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.471057 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.472150 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.473334 (+ 1184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.473514 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:56.473582 (+ 68us) server_negotiation.cc:299] Negotiation successful
0806 11:49:56.473729 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":148,"threads_started":1}
I20260806 11:49:56.473950 14798 ts_tablet_manager.cc:1397] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 11:49:56.474455 14798 raft_consensus.cc:348] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:56.474587 14798 raft_consensus.cc:374] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:56.474623 14798 raft_consensus.cc:729] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d06abea3a8347f4b9e4f2e4cff128da, State: Initialized, Role: FOLLOWER
I20260806 11:49:56.474634 14794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.466637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:37121 (local address 127.0.0.1:54666)
0806 11:49:56.467303 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:56.467319 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:56.467433 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:56.468749 (+ 1316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:56.468752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:56.468773 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:56.468916 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.468926 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.470444 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.470449 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.472486 (+ 2037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.472495 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.474221 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.474225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.474314 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.474336 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 11:49:56.474407 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 11:49:56.474489 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":136,"thread_start_us":198,"threads_started":1}
I20260806 11:49:56.474689 14797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.467224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54666 (local address 127.26.172.195:37121)
0806 11:49:56.468232 (+ 1008us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:56.468246 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:56.468271 (+ 25us) server_negotiation.cc:407] Connection header received
0806 11:49:56.468356 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:56.468361 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:56.468567 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:56.468759 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:56.469070 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.470261 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.472829 (+ 2568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.473867 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.474239 (+ 372us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.474376 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:56.474434 (+ 58us) server_negotiation.cc:299] Negotiation successful
0806 11:49:56.474532 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":214,"threads_started":1}
I20260806 11:49:56.474745 14798 consensus_queue.cc:260] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:56.475178 14798 ts_tablet_manager.cc:1428] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 11:49:56.477862 14693 tablet_service.cc:1467] Processing CreateTablet for tablet 80f34734fb684a85b8deba21af1f39e8 (DEFAULT_TABLE table=test-table [id=12b0a6d7d97145eeb7fc218884a263d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:49:56.477862 14501 tablet_service.cc:1467] Processing CreateTablet for tablet 80f34734fb684a85b8deba21af1f39e8 (DEFAULT_TABLE table=test-table [id=12b0a6d7d97145eeb7fc218884a263d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:49:56.479197 14693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80f34734fb684a85b8deba21af1f39e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:56.479192 14501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80f34734fb684a85b8deba21af1f39e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:49:56.488555 14805 tablet_bootstrap.cc:492] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: Bootstrap starting.
I20260806 11:49:56.489213 14803 tablet_bootstrap.cc:492] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: Bootstrap starting.
I20260806 11:49:56.492950 14805 tablet_bootstrap.cc:654] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:56.492954 14803 tablet_bootstrap.cc:654] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: Neither blocks nor log segments found. Creating new log.
I20260806 11:49:56.494307 14805 log.cc:824] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:56.494307 14803 log.cc:824] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:56.497128 14803 tablet_bootstrap.cc:492] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: No bootstrap required, opened a new log
I20260806 11:49:56.497331 14805 tablet_bootstrap.cc:492] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: No bootstrap required, opened a new log
I20260806 11:49:56.497399 14803 ts_tablet_manager.cc:1397] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260806 11:49:56.497640 14805 ts_tablet_manager.cc:1397] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260806 11:49:56.501205 14803 raft_consensus.cc:348] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:56.501617 14803 raft_consensus.cc:374] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:56.501704 14803 raft_consensus.cc:729] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7dfd162335a4a0bae7891291c9ccb1c, State: Initialized, Role: FOLLOWER
I20260806 11:49:56.501765 14805 raft_consensus.cc:348] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:56.502122 14805 raft_consensus.cc:374] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:49:56.502202 14805 raft_consensus.cc:729] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f73127f5a9024bf79ee0d14ddc144a4a, State: Initialized, Role: FOLLOWER
I20260806 11:49:56.502256 14803 consensus_queue.cc:260] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:56.502884 14805 consensus_queue.cc:260] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:56.503134 14779 heartbeater.cc:503] Master 127.26.172.254:40475 was elected leader, sending a full tablet report...
I20260806 11:49:56.503599 14803 ts_tablet_manager.cc:1428] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260806 11:49:56.503856 14600 heartbeater.cc:503] Master 127.26.172.254:40475 was elected leader, sending a full tablet report...
I20260806 11:49:56.504194 14805 ts_tablet_manager.cc:1428] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260806 11:49:56.555305 14815 raft_consensus.cc:482] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:49:56.555756 14815 raft_consensus.cc:504] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:56.557708 14815 leader_election.cc:288] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121), 8d06abea3a8347f4b9e4f2e4cff128da (127.26.172.193:33531)
I20260806 11:49:56.563351 14816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.558270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:53341 (local address 127.26.172.193:33531)
0806 11:49:56.558752 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:56.558771 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:56.558787 (+ 16us) server_negotiation.cc:407] Connection header received
0806 11:49:56.558926 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:56.558929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:56.559008 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:56.559196 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:56.559823 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.560406 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.561524 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.562278 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.562422 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.562606 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:56.563123 (+ 517us) server_negotiation.cc:299] Negotiation successful
0806 11:49:56.563205 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":193,"threads_started":1}
I20260806 11:49:56.563403 14602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.558089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:33531 (local address 127.26.172.194:53341)
0806 11:49:56.558302 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:56.558325 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:56.558493 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:56.559236 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:56.559241 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:56.559262 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:56.559408 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.559413 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.560549 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.560552 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.561387 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.561398 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.562453 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.562458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.562941 (+ 483us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.562981 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 11:49:56.563098 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 11:49:56.563216 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":224}
I20260806 11:49:56.564297 14797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.558392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:47081 (local address 127.26.172.195:37121)
0806 11:49:56.558550 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:56.558555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:56.559153 (+ 598us) server_negotiation.cc:407] Connection header received
0806 11:49:56.559337 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:56.559343 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:56.559406 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:56.559500 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:49:56.559780 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.560408 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.562941 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.563628 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.563783 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.563850 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:56.564062 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 11:49:56.564166 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 11:49:56.564293 14817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.558089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:37121 (local address 127.26.172.194:47081)
0806 11:49:56.559025 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:56.559039 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:56.559192 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:56.559538 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:56.559543 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:56.559564 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:49:56.559665 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.559669 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.561562 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.561565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.562713 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:56.562723 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.563791 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.563797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:56.563900 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.563927 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 11:49:56.564011 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 11:49:56.564111 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":442,"thread_start_us":180,"threads_started":1}
I20260806 11:49:56.564410 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f34734fb684a85b8deba21af1f39e8" candidate_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" is_pre_election: true
I20260806 11:49:56.564798 14333 raft_consensus.cc:2454] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f73127f5a9024bf79ee0d14ddc144a4a in term 0.
I20260806 11:49:56.565395 14445 leader_election.cc:302] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d06abea3a8347f4b9e4f2e4cff128da, f73127f5a9024bf79ee0d14ddc144a4a; no voters:
I20260806 11:49:56.565445 14721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f34734fb684a85b8deba21af1f39e8" candidate_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" is_pre_election: true
I20260806 11:49:56.565783 14815 raft_consensus.cc:2781] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:49:56.565886 14815 raft_consensus.cc:482] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:49:56.565927 14815 raft_consensus.cc:3037] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:56.565861 14721 raft_consensus.cc:2454] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f73127f5a9024bf79ee0d14ddc144a4a in term 0.
I20260806 11:49:56.567363 14815 raft_consensus.cc:504] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:56.567859 14815 leader_election.cc:288] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [CANDIDATE]: Term 1 election: Requested vote from peers e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121), 8d06abea3a8347f4b9e4f2e4cff128da (127.26.172.193:33531)
I20260806 11:49:56.568449 14333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f34734fb684a85b8deba21af1f39e8" candidate_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d06abea3a8347f4b9e4f2e4cff128da"
I20260806 11:49:56.568564 14721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f34734fb684a85b8deba21af1f39e8" candidate_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7dfd162335a4a0bae7891291c9ccb1c"
I20260806 11:49:56.568760 14333 raft_consensus.cc:3037] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:56.568790 14721 raft_consensus.cc:3037] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:49:56.570022 14721 raft_consensus.cc:2454] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f73127f5a9024bf79ee0d14ddc144a4a in term 1.
I20260806 11:49:56.570282 14333 raft_consensus.cc:2454] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f73127f5a9024bf79ee0d14ddc144a4a in term 1.
I20260806 11:49:56.570469 14446 leader_election.cc:302] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e7dfd162335a4a0bae7891291c9ccb1c, f73127f5a9024bf79ee0d14ddc144a4a; no voters:
I20260806 11:49:56.570789 14815 raft_consensus.cc:2781] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:49:56.571115 14815 raft_consensus.cc:686] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 1 LEADER]: Becoming Leader. State: Replica: f73127f5a9024bf79ee0d14ddc144a4a, State: Running, Role: LEADER
I20260806 11:49:56.571535 14815 consensus_queue.cc:237] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:56.575476 14128 catalog_manager.cc:5495] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a reported cstate change: term changed from 0 to 1, leader changed from <none> to f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194). New cstate: current_term: 1 leader_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } health_report { overall_health: UNKNOWN } } }
I20260806 11:49:56.611416 14793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.607118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45838 (local address 127.26.172.194:35307)
0806 11:49:56.607318 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:56.607323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:56.607341 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:49:56.607584 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:56.607587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:56.607677 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:56.607821 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:49:56.608131 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.608683 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.609580 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:56.609810 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:56.609927 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:56.610302 (+ 375us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:49:56.610952 (+ 650us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:49:56.611115 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:56.611154 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 11:49:56.611228 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 11:49:56.619710 14333 raft_consensus.cc:1261] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Refusing update from remote peer f73127f5a9024bf79ee0d14ddc144a4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:49:56.619791 14721 raft_consensus.cc:1261] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c [term 1 FOLLOWER]: Refusing update from remote peer f73127f5a9024bf79ee0d14ddc144a4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:49:56.620826 14818 consensus_queue.cc:1035] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:49:56.621161 14815 consensus_queue.cc:1035] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:49:56.627691 14822 mvcc.cc:205] Tried to move back new op lower bound from 7315525618143371264 to 7315525617960206336. Current Snapshot: MvccSnapshot[applied={T|T < 7315525618143371264}]
I20260806 11:49:56.634542 14829 mvcc.cc:205] Tried to move back new op lower bound from 7315525618143371264 to 7315525617960206336. Current Snapshot: MvccSnapshot[applied={T|T < 7315525618143371264}]
I20260806 11:49:56.640532 14128 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:43960:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:49:56.640719 14128 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:43960:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:49:56.643586 14128 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Sending DeleteTablet for 3 replicas of tablet 80f34734fb684a85b8deba21af1f39e8
I20260806 11:49:56.644404 14308 tablet_service.cc:1514] Processing DeleteTablet for tablet 80f34734fb684a85b8deba21af1f39e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:49:56 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:39914
I20260806 11:49:56.644672 14693 tablet_service.cc:1514] Processing DeleteTablet for tablet 80f34734fb684a85b8deba21af1f39e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:49:56 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:54666
I20260806 11:49:56.645262 14839 tablet_replica.cc:330] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: stopping tablet replica
I20260806 11:49:56.645465 14501 tablet_service.cc:1514] Processing DeleteTablet for tablet 80f34734fb684a85b8deba21af1f39e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:49:56 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:45836
I20260806 11:49:56.645790 14839 raft_consensus.cc:2229] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:49:56.646224 14839 raft_consensus.cc:2258] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:49:56.646281 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 14189
I20260806 11:49:56.656438 14839 ts_tablet_manager.cc:1905] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:49:56.659801 14839 ts_tablet_manager.cc:1918] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:49:56.659916 14839 log.cc:1196] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/80f34734fb684a85b8deba21af1f39e8
I20260806 11:49:56.660135 14840 tablet_replica.cc:330] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: stopping tablet replica
I20260806 11:49:56.660301 14839 ts_tablet_manager.cc:1939] T 80f34734fb684a85b8deba21af1f39e8 P e7dfd162335a4a0bae7891291c9ccb1c: Deleting consensus metadata
I20260806 11:49:56.660558 14840 raft_consensus.cc:2229] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:49:56.660981 14840 raft_consensus.cc:2258] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:49:56.662227 14110 catalog_manager.cc:4841] TS e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121): tablet 80f34734fb684a85b8deba21af1f39e8 (table test-table [id=12b0a6d7d97145eeb7fc218884a263d0]) successfully deleted
I20260806 11:49:56.663851 14840 ts_tablet_manager.cc:1905] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:49:56.667572 14840 ts_tablet_manager.cc:1918] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:49:56.667685 14840 log.cc:1196] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/80f34734fb684a85b8deba21af1f39e8
I20260806 11:49:56.668015 14840 ts_tablet_manager.cc:1939] T 80f34734fb684a85b8deba21af1f39e8 P f73127f5a9024bf79ee0d14ddc144a4a: Deleting consensus metadata
I20260806 11:49:56.669337 14110 catalog_manager.cc:4841] TS f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307): tablet 80f34734fb684a85b8deba21af1f39e8 (table test-table [id=12b0a6d7d97145eeb7fc218884a263d0]) successfully deleted
W20260806 11:49:56.677690 14108 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:33531 (error 108)
I20260806 11:49:56.678671 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 14409
I20260806 11:49:56.679350 14794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:56.678896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:33531 (local address 127.0.0.1:39918)
0806 11:49:56.679085 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:56.679196 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:33531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 11:49:56.685467 14108 catalog_manager.cc:4584] TS 8d06abea3a8347f4b9e4f2e4cff128da (127.26.172.193:33531): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 80f34734fb684a85b8deba21af1f39e8: Network error: Client connection negotiation failed: client connection to 127.26.172.193:33531: connect: Connection refused (error 111)
I20260806 11:49:56.695714 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 14603
I20260806 11:49:56.713706 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 14087
I20260806 11:49:56.734411 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40475
--webserver_interface=127.26.172.254
--webserver_port=41107
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:40475
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:56.885358 14843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:56.885771 14843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:56.885828 14843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:56.890558 14843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:49:56.890678 14843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:56.890703 14843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:56.890726 14843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:49:56.890774 14843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:49:56.897816 14843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:40475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=41107
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:56.899509 14843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:56.901026 14843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:56.912199 14853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:56.912185 14854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:56.912186 14857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:56.912529 14843 server_base.cc:1034] running on GCE node
I20260806 11:49:56.913661 14843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:56.915630 14843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:56.916852 14843 hybrid_clock.cc:648] HybridClock initialized: now 1786016996916812 us; error 64 us; skew 500 ppm
Aug 06 11:49:56 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016996, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:56.921057 14843 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:49:56.922534 14843 webserver.cc:460] Webserver started at http://127.26.172.254:41107/ using document root <none> and password file <none>
I20260806 11:49:56.923547 14843 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:56.923645 14843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:56.929719 14843 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260806 11:49:56.933238 14866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:56.935264 14843 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:49:56.935473 14843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "ac54bd625e0e4a349f28050b6bb9c8eb"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "a30fddd1ff6eb796aa4d1c2fbacbd93f"
server_key_iv: "4e44040739f3f03f905aa24d52542b79"
server_key_version: "encryptionkey@0"
I20260806 11:49:56.936290 14843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:56.949564 14843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:56.953935 14843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:56.954283 14843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:56.965570 14843 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:40475
I20260806 11:49:56.966045 14933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:40475 every 8 connection(s)
I20260806 11:49:56.967419 14843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:49:56.972921 14934 sys_catalog.cc:263] Verifying existing consensus state
I20260806 11:49:56.975101 14934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Bootstrap starting.
I20260806 11:49:56.975808 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 14843
I20260806 11:49:56.976418 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:33531
--local_ip_for_outbound_sockets=127.26.172.193
--tserver_master_addrs=127.26.172.254:40475
--webserver_port=46743
--webserver_interface=127.26.172.193
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:49:56.996534 14934 log.cc:824] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Log is configured to *not* fsync() on all Append() calls
I20260806 11:49:57.009039 14934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:49:57.009539 14934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: Bootstrap complete.
I20260806 11:49:57.014282 14934 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:57.014750 14934 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac54bd625e0e4a349f28050b6bb9c8eb, State: Initialized, Role: FOLLOWER
I20260806 11:49:57.015331 14934 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:57.015486 14934 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:49:57.015580 14934 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:49:57.015712 14934 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 2 FOLLOWER]: Advancing to term 3
I20260806 11:49:57.017912 14934 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:57.018317 14934 leader_election.cc:302] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac54bd625e0e4a349f28050b6bb9c8eb; no voters:
I20260806 11:49:57.018754 14934 leader_election.cc:288] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 11:49:57.018890 14940 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 3 FOLLOWER]: Leader election won for term 3
I20260806 11:49:57.019122 14940 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [term 3 LEADER]: Becoming Leader. State: Replica: ac54bd625e0e4a349f28050b6bb9c8eb, State: Running, Role: LEADER
I20260806 11:49:57.019476 14940 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } }
I20260806 11:49:57.020257 14934 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:49:57.021158 14943 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } } }
I20260806 11:49:57.021747 14943 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:57.021620 14940 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac54bd625e0e4a349f28050b6bb9c8eb. Latest consensus state: current_term: 3 leader_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac54bd625e0e4a349f28050b6bb9c8eb" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40475 } } }
I20260806 11:49:57.022203 14940 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb [sys.catalog]: This master's current role is: LEADER
I20260806 11:49:57.026926 14965 catalog_manager.cc:1259] Loaded cluster ID: d8142e495f4543618ed08f1ef1f0012c
I20260806 11:49:57.027024 14965 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: loading cluster ID for follower catalog manager: success
W20260806 11:49:57.028551 14965 catalog_manager.cc:1576] T 00000000000000000000000000000000 P ac54bd625e0e4a349f28050b6bb9c8eb: acquiring CA information for follower catalog manager: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
W20260806 11:49:57.028649 14965 catalog_manager.cc:873] Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO: failed to prepare follower catalog manager, will retry
I20260806 11:49:57.028749 14959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:49:57.031728 14959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:49:57.032301 14959 catalog_manager.cc:1259] Loaded cluster ID: d8142e495f4543618ed08f1ef1f0012c
I20260806 11:49:57.032382 14959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 11:49:57.033082 14959 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe648cec9ad google::LogMessage::Fail() at ??:0
@ 0x7fe648cef88a google::LogMessage::SendToLog() at ??:0
@ 0x7fe648cec4de google::LogMessage::Flush() at ??:0
@ 0x7fe648ceda19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe65362bfdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fe65362cd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe653629579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fe65366d640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fe64af3e3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe64af3ec83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fe64af403f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fe64af2f512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe64c5736db start_thread at ??:0
@ 0x7fe6477ea61f clone at ??:0
W20260806 11:49:57.164168 14936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:57.164543 14936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:57.164594 14936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:57.169580 14936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:57.169709 14936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:57.169785 14936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:49:57.176450 14936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:33531
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=46743
--tserver_master_addrs=127.26.172.254:40475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:57.178205 14936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:57.179792 14936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:57.193436 15000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:57.193531 14997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:57.193406 14998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:57.194525 14936 server_base.cc:1034] running on GCE node
I20260806 11:49:57.195371 14936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:57.196336 14936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:57.199651 14936 hybrid_clock.cc:648] HybridClock initialized: now 1786016997199600 us; error 76 us; skew 500 ppm
Aug 06 11:49:57 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016997, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:57.203724 14936 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:49:57.205355 14936 webserver.cc:460] Webserver started at http://127.26.172.193:46743/ using document root <none> and password file <none>
I20260806 11:49:57.206293 14936 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:57.206416 14936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:57.212906 14936 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:49:57.216699 15008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:57.219185 14936 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 11:49:57.219415 14936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "8d06abea3a8347f4b9e4f2e4cff128da"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "5008106a870fba1ee9ab0d662d43d458"
server_key_iv: "7441fe6ba0b0afa011adaf5bda5f2d2d"
server_key_version: "encryptionkey@0"
I20260806 11:49:57.220391 14936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:57.242875 14936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:57.247443 14936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:57.247694 14936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:57.248588 14936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:57.250258 15021 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 11:49:57.256805 14936 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 11:49:57.256953 14936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260806 11:49:57.257042 14936 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 11:49:57.260015 14936 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 11:49:57.260103 14936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20260806 11:49:57.260789 15021 tablet_bootstrap.cc:492] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: Bootstrap starting.
I20260806 11:49:57.281000 14936 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:33531
I20260806 11:49:57.281394 15182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:33531 every 8 connection(s)
I20260806 11:49:57.282416 14936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:49:57.287554 15185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.285482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:44527)
0806 11:49:57.286265 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.286419 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":228,"threads_started":1}
I20260806 11:49:57.287905 15021 log.cc:824] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: Log is configured to *not* fsync() on all Append() calls
W20260806 11:49:57.288182 15183 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:40475 (0 consecutive failures): Network error: Failed to ping master at 127.26.172.254:40475: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
I20260806 11:49:57.289111 15185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.288756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:42001)
0806 11:49:57.288924 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.289009 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 11:49:57.290103 15185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.289745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:50545)
0806 11:49:57.289920 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.289997 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 11:49:57.290374 15183 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 11:49:57.291780 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 14936
I20260806 11:49:57.292342 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:35307
--local_ip_for_outbound_sockets=127.26.172.194
--tserver_master_addrs=127.26.172.254:40475
--webserver_port=39001
--webserver_interface=127.26.172.194
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:49:57.297287 15021 tablet_bootstrap.cc:492] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:49:57.297708 15021 tablet_bootstrap.cc:492] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: Bootstrap complete.
I20260806 11:49:57.299306 15021 ts_tablet_manager.cc:1397] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: Time spent bootstrapping tablet: real 0.039s user 0.027s sys 0.011s
I20260806 11:49:57.302277 15021 raft_consensus.cc:348] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:57.302743 15021 raft_consensus.cc:729] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d06abea3a8347f4b9e4f2e4cff128da, State: Initialized, Role: FOLLOWER
I20260806 11:49:57.303303 15021 consensus_queue.cc:260] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:57.304441 15021 ts_tablet_manager.cc:1428] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 11:49:57.305214 15185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.304888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:40133)
0806 11:49:57.305054 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.305135 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 11:49:57.306308 15185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.306003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:36005)
0806 11:49:57.306174 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.306239 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260806 11:49:57.438133 15190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:57.438536 15190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:57.438596 15190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:57.443109 15190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:57.443199 15190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:57.443269 15190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:49:57.449399 15190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:35307
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=39001
--tserver_master_addrs=127.26.172.254:40475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:57.450990 15190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:57.452359 15190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:57.465022 15197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:57.465030 15198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:57.465099 15200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:57.465654 15190 server_base.cc:1034] running on GCE node
I20260806 11:49:57.466188 15190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:57.467082 15190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:57.468299 15190 hybrid_clock.cc:648] HybridClock initialized: now 1786016997468266 us; error 50 us; skew 500 ppm
Aug 06 11:49:57 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016997, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:57.475221 15190 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:49:57.476449 15190 webserver.cc:460] Webserver started at http://127.26.172.194:39001/ using document root <none> and password file <none>
I20260806 11:49:57.477129 15190 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:57.477205 15190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:57.482578 15190 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 11:49:57.485481 15211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:57.487445 15190 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:49:57.487605 15190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "f73127f5a9024bf79ee0d14ddc144a4a"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "c47c80aa8cb24e9049099c075420799e"
server_key_iv: "57ae6c5e52fee120dddd21c55bd2c276"
server_key_version: "encryptionkey@0"
I20260806 11:49:57.488246 15190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:57.524994 15190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:57.528623 15190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:57.528805 15190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:57.529479 15190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:57.530486 15190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:57.530542 15190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:57.530586 15190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:57.530601 15190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:57.542667 15190 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:35307
I20260806 11:49:57.542747 15364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:35307 every 8 connection(s)
I20260806 11:49:57.544093 15190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:49:57.549752 15371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.547152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:32945)
0806 11:49:57.547786 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.548478 (+ 692us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":136,"threads_started":1}
W20260806 11:49:57.550598 15366 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:40475 (0 consecutive failures): Network error: Failed to ping master at 127.26.172.254:40475: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
I20260806 11:49:57.551535 15371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.551167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:42369)
0806 11:49:57.551351 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.551442 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 11:49:57.552958 15371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.552632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:33933)
0806 11:49:57.552782 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.552847 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 11:49:57.553267 15366 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 11:49:57.554005 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 15190
I20260806 11:49:57.554489 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:37121
--local_ip_for_outbound_sockets=127.26.172.195
--tserver_master_addrs=127.26.172.254:40475
--webserver_port=41495
--webserver_interface=127.26.172.195
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:43159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:49:57.687829 15372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:49:57.688151 15372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:49:57.688198 15372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:49:57.692329 15372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:49:57.692404 15372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:49:57.692467 15372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:49:57.698156 15372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:43159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:37121
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=41495
--tserver_master_addrs=127.26.172.254:40475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:49:57.699436 15372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:49:57.700575 15372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:49:57.712841 15377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:57.712817 15378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:49:57.712823 15380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:49:57.712962 15372 server_base.cc:1034] running on GCE node
I20260806 11:49:57.713716 15372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:49:57.714581 15372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:49:57.715830 15372 hybrid_clock.cc:648] HybridClock initialized: now 1786016997715797 us; error 52 us; skew 500 ppm
Aug 06 11:49:57 dist-test-slave-7z32 krb5kdc[13314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016997, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:49:57.719683 15372 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:49:57.720886 15372 webserver.cc:460] Webserver started at http://127.26.172.195:41495/ using document root <none> and password file <none>
I20260806 11:49:57.721582 15372 fs_manager.cc:359] Metadata directory not provided
I20260806 11:49:57.721695 15372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:49:57.727809 15372 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260806 11:49:57.730717 15391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:57.732715 15372 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 11:49:57.732928 15372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "e7dfd162335a4a0bae7891291c9ccb1c"
format_stamp: "Formatted at 2026-08-06 11:49:54 on dist-test-slave-7z32"
server_key: "175c60683432d5acc6c0db50240acfa4"
server_key_iv: "8a04cf538a83e9dcade762b9b7b8880a"
server_key_version: "encryptionkey@0"
I20260806 11:49:57.733635 15372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:49:57.756073 15372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:49:57.760108 15372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:49:57.760386 15372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:49:57.761169 15372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:49:57.762198 15372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:49:57.762284 15372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:57.762385 15372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:49:57.762428 15372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:49:57.774885 15372 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:37121
I20260806 11:49:57.774945 15553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:37121 every 8 connection(s)
I20260806 11:49:57.776237 15372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:49:57.782213 15556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.779796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:36069)
0806 11:49:57.780625 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.781252 (+ 627us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":201,"threads_started":1}
W20260806 11:49:57.783084 15554 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:40475 (0 consecutive failures): Network error: Failed to ping master at 127.26.172.254:40475: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
I20260806 11:49:57.784140 15556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.783774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:52607)
0806 11:49:57.783978 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.784059 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260806 11:49:57.785303 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 15372
I20260806 11:49:57.785326 15556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:57.784988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:55561)
0806 11:49:57.785162 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:57.785236 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260806 11:49:57.785835 15554 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 11:49:58.308125 15561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:58.307560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:59567)
0806 11:49:58.307909 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:58.307989 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":97,"threads_started":1}
I20260806 11:49:58.554821 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:58.554105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:57953)
0806 11:49:58.554555 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:58.554654 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":98,"threads_started":1}
I20260806 11:49:58.787310 15564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:58.786628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:44971)
0806 11:49:58.787021 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:58.787120 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":87,"threads_started":1}
I20260806 11:49:58.848877 15565 raft_consensus.cc:482] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:49:58.849161 15565 raft_consensus.cc:504] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:49:58.850394 15565 leader_election.cc:288] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307), e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121)
Aug 06 11:49:58 dist-test-slave-7z32 krb5kdc[13314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016997, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.194@KRBTEST.COM
Aug 06 11:49:58 dist-test-slave-7z32 krb5kdc[13314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786016997, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.195@KRBTEST.COM
I20260806 11:49:58.871945 15570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:58.851794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:47457 (local address 127.26.172.195:37121)
0806 11:49:58.852332 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:58.852395 (+ 63us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:58.852430 (+ 35us) server_negotiation.cc:407] Connection header received
0806 11:49:58.853291 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:58.853298 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:58.853716 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:58.854118 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:58.855409 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:58.857257 (+ 1848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:58.859578 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:58.860552 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:58.860836 (+ 284us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:58.865172 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:58.865179 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:58.865217 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:58.865266 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:58.867655 (+ 2389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:58.868751 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:58.868756 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:58.868761 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:58.868900 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:58.869483 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:58.869486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:58.869488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:58.870126 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:58.870280 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:58.871337 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0806 11:49:58.871716 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":96,"threads_started":1}
I20260806 11:49:58.871945 15568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:58.851203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:38335 (local address 127.26.172.194:35307)
0806 11:49:58.851901 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0806 11:49:58.851935 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0806 11:49:58.852005 (+ 70us) server_negotiation.cc:407] Connection header received
0806 11:49:58.852980 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:49:58.852988 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:49:58.853337 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:49:58.853667 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:49:58.855410 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:58.857257 (+ 1847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:58.859578 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:49:58.860614 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:49:58.860836 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:58.864806 (+ 3970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:49:58.864817 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:49:58.864845 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:49:58.864893 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:49:58.867545 (+ 2652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:58.868710 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:58.868720 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:58.868727 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:58.868900 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:49:58.869482 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:49:58.869485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:49:58.869487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:49:58.870126 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:49:58.870280 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 11:49:58.871337 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0806 11:49:58.871716 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":204,"threads_started":1}
I20260806 11:49:58.871973 15569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:58.851523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:37121 (local address 127.26.172.193:47457)
0806 11:49:58.851959 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:58.851978 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:58.852140 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:58.854206 (+ 2066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:58.854209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:58.854418 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:58.855107 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:58.855132 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:58.857512 (+ 2380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:58.857517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:58.859357 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:58.859372 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:58.860795 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:58.860799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:58.861111 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:58.862063 (+ 952us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:58.862103 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:58.864860 (+ 2757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:58.867791 (+ 2931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:58.867801 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:58.867827 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:58.868525 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:58.869019 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:58.869022 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:58.869025 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:58.869348 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:58.870282 (+ 934us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:58.870291 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:58.870818 (+ 527us) client_negotiation.cc:769] Sending connection context
0806 11:49:58.871126 (+ 308us) client_negotiation.cc:240] Negotiation successful
0806 11:49:58.871706 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":265,"spinlock_wait_cycles":85248,"thread_start_us":86,"threads_started":1}
I20260806 11:49:58.871973 15567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:58.850987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35307 (local address 127.26.172.193:38335)
0806 11:49:58.851354 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:58.851385 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 11:49:58.851996 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:49:58.853754 (+ 1758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:49:58.853763 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:49:58.854779 (+ 1016us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:49:58.855159 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:58.855167 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:58.857512 (+ 2345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:58.857517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:58.859357 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:49:58.859372 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:49:58.860795 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:49:58.860799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:49:58.861111 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:49:58.862063 (+ 952us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:49:58.862091 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:49:58.864360 (+ 2269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:49:58.867791 (+ 3431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:58.867802 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:58.867827 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:58.868525 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:58.869019 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:49:58.869022 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:49:58.869025 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:49:58.869348 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:49:58.870282 (+ 934us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:49:58.870291 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:49:58.870839 (+ 548us) client_negotiation.cc:769] Sending connection context
0806 11:49:58.871126 (+ 287us) client_negotiation.cc:240] Negotiation successful
0806 11:49:58.871770 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":676,"spinlock_wait_cycles":48000,"thread_start_us":123,"threads_started":1}
W20260806 11:49:58.875823 15014 leader_election.cc:341] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307): Not found: Tablet not found: 80f34734fb684a85b8deba21af1f39e8
W20260806 11:49:58.876122 15014 leader_election.cc:341] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121): Not found: Tablet not found: 80f34734fb684a85b8deba21af1f39e8
I20260806 11:49:58.876240 15014 leader_election.cc:302] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d06abea3a8347f4b9e4f2e4cff128da; no voters: e7dfd162335a4a0bae7891291c9ccb1c, f73127f5a9024bf79ee0d14ddc144a4a
I20260806 11:49:58.876749 15565 raft_consensus.cc:2726] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:49:59.309909 15569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:59.309346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:34183)
0806 11:49:59.309685 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:59.309788 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161}
I20260806 11:49:59.556602 15571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:59.555879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:50639)
0806 11:49:59.556352 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:59.556458 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":109,"threads_started":1}
I20260806 11:49:59.789219 15572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:49:59.788546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:50291)
0806 11:49:59.789007 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 11:49:59.789100 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":133,"threads_started":1}
I20260806 11:50:00.311929 15578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:00.311229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:46261)
0806 11:50:00.311715 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:00.311811 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":131,"threads_started":1}
I20260806 11:50:00.558350 15579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:00.557701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:50271)
0806 11:50:00.558107 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:00.558189 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":146,"threads_started":1}
I20260806 11:50:00.751438 15581 raft_consensus.cc:482] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:50:00.751662 15581 raft_consensus.cc:504] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:50:00.752317 15581 leader_election.cc:288] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307), e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121)
W20260806 11:50:00.753501 15014 leader_election.cc:341] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307): Not found: Tablet not found: 80f34734fb684a85b8deba21af1f39e8
W20260806 11:50:00.753731 15014 leader_election.cc:341] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121): Not found: Tablet not found: 80f34734fb684a85b8deba21af1f39e8
I20260806 11:50:00.753779 15014 leader_election.cc:302] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d06abea3a8347f4b9e4f2e4cff128da; no voters: e7dfd162335a4a0bae7891291c9ccb1c, f73127f5a9024bf79ee0d14ddc144a4a
I20260806 11:50:00.753942 15581 raft_consensus.cc:2726] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:50:00.791354 15582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:00.790654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:51965)
0806 11:50:00.791111 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:00.791203 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":176,"threads_started":1}
I20260806 11:50:01.313798 15583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:01.313116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:32997)
0806 11:50:01.313520 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:01.313612 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":101,"threads_started":1}
I20260806 11:50:01.560079 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:01.559462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:50281)
0806 11:50:01.559849 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:01.559938 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":93,"threads_started":1}
I20260806 11:50:01.793341 15585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:01.792794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:59119)
0806 11:50:01.793142 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:01.793219 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":122,"threads_started":1}
I20260806 11:50:02.315747 15586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:02.315201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:37999)
0806 11:50:02.315558 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:02.315624 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":103,"threads_started":1}
I20260806 11:50:02.561961 15587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:02.561304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:46067)
0806 11:50:02.561732 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:02.561838 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":110,"threads_started":1}
I20260806 11:50:02.795485 15588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:02.794676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:46111)
0806 11:50:02.795183 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:02.795279 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":185,"threads_started":1}
I20260806 11:50:03.317526 15590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:03.316768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:51583)
0806 11:50:03.317275 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:03.317381 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":97,"threads_started":1}
I20260806 11:50:03.563938 15591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:03.563354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:35809)
0806 11:50:03.563727 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:03.563826 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":117,"threads_started":1}
I20260806 11:50:03.797178 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:03.796712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:53807)
0806 11:50:03.797000 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:03.797076 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":116,"threads_started":1}
I20260806 11:50:03.918437 15593 raft_consensus.cc:482] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:50:03.918658 15593 raft_consensus.cc:504] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:50:03.919404 15593 leader_election.cc:288] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307), e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121)
W20260806 11:50:03.920832 15014 leader_election.cc:341] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307): Not found: Tablet not found: 80f34734fb684a85b8deba21af1f39e8
W20260806 11:50:03.921154 15014 leader_election.cc:341] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121): Not found: Tablet not found: 80f34734fb684a85b8deba21af1f39e8
I20260806 11:50:03.921255 15014 leader_election.cc:302] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d06abea3a8347f4b9e4f2e4cff128da; no voters: e7dfd162335a4a0bae7891291c9ccb1c, f73127f5a9024bf79ee0d14ddc144a4a
I20260806 11:50:03.921581 15593 raft_consensus.cc:2726] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:50:04.319262 15594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:04.318541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:38745)
0806 11:50:04.319024 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:04.319119 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":92,"threads_started":1}
I20260806 11:50:04.565939 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:04.565193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:52063)
0806 11:50:04.565713 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:04.565800 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":116,"threads_started":1}
I20260806 11:50:04.799516 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:04.798634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:38241)
0806 11:50:04.799215 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:04.799402 (+ 187us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":216,"threads_started":1}
I20260806 11:50:05.320996 15597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:05.320467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:49713)
0806 11:50:05.320818 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:05.320886 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":92,"threads_started":1}
I20260806 11:50:05.567873 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:05.567117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:36937)
0806 11:50:05.567601 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:05.567720 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":112,"threads_started":1}
I20260806 11:50:05.801222 15599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:05.800625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:52431)
0806 11:50:05.801032 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:05.801108 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":133,"threads_started":1}
I20260806 11:50:06.323031 15600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:06.322246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:41471)
0806 11:50:06.322711 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:06.322799 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":130,"threads_started":1}
I20260806 11:50:06.447655 15601 raft_consensus.cc:482] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:50:06.447880 15601 raft_consensus.cc:504] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:50:06.448578 15601 leader_election.cc:288] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307), e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121)
W20260806 11:50:06.449784 15014 leader_election.cc:341] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307): Not found: Tablet not found: 80f34734fb684a85b8deba21af1f39e8
W20260806 11:50:06.450023 15014 leader_election.cc:341] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121): Not found: Tablet not found: 80f34734fb684a85b8deba21af1f39e8
I20260806 11:50:06.450089 15014 leader_election.cc:302] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d06abea3a8347f4b9e4f2e4cff128da; no voters: e7dfd162335a4a0bae7891291c9ccb1c, f73127f5a9024bf79ee0d14ddc144a4a
I20260806 11:50:06.450350 15601 raft_consensus.cc:2726] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:50:06.569922 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:06.569143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:52873)
0806 11:50:06.569650 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:06.569748 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":164,"threads_started":1}
I20260806 11:50:06.803054 15605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:06.802333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:54085)
0806 11:50:06.802783 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:06.802931 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":199,"threads_started":1}
I20260806 11:50:07.325138 15606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:07.324501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:41351)
0806 11:50:07.324893 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:07.324993 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":101,"threads_started":1}
I20260806 11:50:07.572036 15609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:07.571331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:41087)
0806 11:50:07.571838 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:07.571901 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":220,"threads_started":1}
I20260806 11:50:07.804780 15612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:07.804182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:57889)
0806 11:50:07.804588 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:07.804661 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":141,"threads_started":1}
I20260806 11:50:08.327067 15614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:08.326306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:41519)
0806 11:50:08.326756 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:08.326916 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":108,"threads_started":1}
I20260806 11:50:08.573839 15615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:08.573191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:57677)
0806 11:50:08.573573 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:08.573670 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":97,"threads_started":1}
I20260806 11:50:08.806572 15616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:08.805864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:40213)
0806 11:50:08.806326 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:08.806429 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":112,"threads_started":1}
I20260806 11:50:09.328836 15617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:09.328260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:60251)
0806 11:50:09.328660 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:09.328727 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":202,"threads_started":1}
I20260806 11:50:09.575801 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:09.575151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:54167)
0806 11:50:09.575559 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:09.575659 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":101,"threads_started":1}
I20260806 11:50:09.808699 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:09.808044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:36539)
0806 11:50:09.808475 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:09.808562 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":136,"threads_started":1}
I20260806 11:50:10.330578 15620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:10.329943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:40785)
0806 11:50:10.330362 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:10.330461 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":130,"threads_started":1}
I20260806 11:50:10.577698 15621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:10.577016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:40081)
0806 11:50:10.577419 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:10.577514 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":100,"threads_started":1}
I20260806 11:50:10.810479 15622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:10.809732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:59069)
0806 11:50:10.810220 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:10.810338 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":131,"threads_started":1}
I20260806 11:50:11.280416 15623 raft_consensus.cc:482] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:50:11.280709 15623 raft_consensus.cc:504] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f73127f5a9024bf79ee0d14ddc144a4a" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35307 } } peers { permanent_uuid: "e7dfd162335a4a0bae7891291c9ccb1c" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 37121 } } peers { permanent_uuid: "8d06abea3a8347f4b9e4f2e4cff128da" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 33531 } }
I20260806 11:50:11.281319 15623 leader_election.cc:288] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307), e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121)
W20260806 11:50:11.282651 15014 leader_election.cc:341] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e7dfd162335a4a0bae7891291c9ccb1c (127.26.172.195:37121): Not found: Tablet not found: 80f34734fb684a85b8deba21af1f39e8
W20260806 11:50:11.282881 15014 leader_election.cc:341] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f73127f5a9024bf79ee0d14ddc144a4a (127.26.172.194:35307): Not found: Tablet not found: 80f34734fb684a85b8deba21af1f39e8
I20260806 11:50:11.282953 15014 leader_election.cc:302] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d06abea3a8347f4b9e4f2e4cff128da; no voters: e7dfd162335a4a0bae7891291c9ccb1c, f73127f5a9024bf79ee0d14ddc144a4a
I20260806 11:50:11.283209 15623 raft_consensus.cc:2726] T 80f34734fb684a85b8deba21af1f39e8 P 8d06abea3a8347f4b9e4f2e4cff128da [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:50:11.332777 15625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:11.332019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:51903)
0806 11:50:11.332433 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:11.332513 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":115,"threads_started":1}
I20260806 11:50:11.579447 15626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:11.578698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:60347)
0806 11:50:11.579200 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:11.579304 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":183,"threads_started":1}
I20260806 11:50:11.812536 15627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:11.811784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:59083)
0806 11:50:11.812254 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:11.812361 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":116,"threads_started":1}
I20260806 11:50:12.334805 15628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:12.334188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.193:38369)
0806 11:50:12.334597 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:12.334670 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":146,"threads_started":1}
I20260806 11:50:12.581619 15629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:12.580927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.194:47065)
0806 11:50:12.581417 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:12.581503 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":147,"threads_started":1}
I20260806 11:50:12.788932 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 14936
I20260806 11:50:12.811939 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 15190
I20260806 11:50:12.821318 15631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:12.819363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:40475 (local address 127.26.172.195:54653)
0806 11:50:12.821033 (+ 1670us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:12.821127 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:40475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1550,"thread_start_us":1354,"threads_started":1}
I20260806 11:50:12.831643 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 15372
2026-08-06T11:50:12Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (20381 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:50:12 dist-test-slave-7z32 krb5kdc[15637](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:50:12 dist-test-slave-7z32 krb5kdc[15637](info): set up 2 sockets
Aug 06 11:50:12 dist-test-slave-7z32 krb5kdc[15637](info): commencing operation
krb5kdc: starting...
W20260806 11:50:14.152375 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.005s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:50:14 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:50:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:50:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:50:14.315973 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46223
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:46223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:50:14.444208 15654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:14.444526 15654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:14.444569 15654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:14.448659 15654 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 11:50:14.448731 15654 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 11:50:14.448747 15654 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 11:50:14.448762 15654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:50:14.448781 15654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:14.448800 15654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:14.448817 15654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:50:14.448832 15654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:50:14.454269 15654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:46223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:14.455565 15654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:14.456645 15654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 11:50:14.467628 15654 server_base.cc:1034] running on GCE node
W20260806 11:50:14.467561 15664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:14.467572 15660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:14.467530 15659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:14.468999 15654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:14.470772 15654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:14.472111 15654 hybrid_clock.cc:648] HybridClock initialized: now 1786017014472058 us; error 75 us; skew 500 ppm
Aug 06 11:50:14 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017014, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:14.476018 15654 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:50:14.477382 15654 webserver.cc:460] Webserver started at http://127.26.172.254:40769/ using document root <none> and password file <none>
I20260806 11:50:14.478196 15654 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:14.478332 15654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:14.478648 15654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:50:14.481511 15654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "699a4c6870f6433eb68a5fcd62d121a9"
format_stamp: "Formatted at 2026-08-06 11:50:14 on dist-test-slave-7z32"
server_key: "b0d71af6c7b8420cce077350d8403faf"
server_key_iv: "3c30960d5f265acca9250fb3642bfad1"
server_key_version: "encryptionkey@0"
I20260806 11:50:14.482275 15654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "699a4c6870f6433eb68a5fcd62d121a9"
format_stamp: "Formatted at 2026-08-06 11:50:14 on dist-test-slave-7z32"
server_key: "b0d71af6c7b8420cce077350d8403faf"
server_key_iv: "3c30960d5f265acca9250fb3642bfad1"
server_key_version: "encryptionkey@0"
I20260806 11:50:14.487789 15654 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 11:50:14.491308 15676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:14.493201 15654 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:50:14.493420 15654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "699a4c6870f6433eb68a5fcd62d121a9"
format_stamp: "Formatted at 2026-08-06 11:50:14 on dist-test-slave-7z32"
server_key: "b0d71af6c7b8420cce077350d8403faf"
server_key_iv: "3c30960d5f265acca9250fb3642bfad1"
server_key_version: "encryptionkey@0"
I20260806 11:50:14.493588 15654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:14.520792 15654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:14.525242 15654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:14.525554 15654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:14.535717 15654 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:46223
I20260806 11:50:14.536116 15752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:46223 every 8 connection(s)
I20260806 11:50:14.537286 15654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:50:14.540920 15753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:50:14.547243 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 15654
I20260806 11:50:14.547406 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:50:14.547502 15753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Bootstrap starting.
I20260806 11:50:14.547869 27315 external_mini_cluster.cc:1428] Setting key 9afd30dced926826e42d597af26a1585
I20260806 11:50:14.550551 15753 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Neither blocks nor log segments found. Creating new log.
I20260806 11:50:14.551519 15753 log.cc:824] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Log is configured to *not* fsync() on all Append() calls
I20260806 11:50:14.554123 15753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: No bootstrap required, opened a new log
I20260806 11:50:14.559255 15753 raft_consensus.cc:348] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:14.559626 15753 raft_consensus.cc:374] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:50:14.559691 15753 raft_consensus.cc:729] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 699a4c6870f6433eb68a5fcd62d121a9, State: Initialized, Role: FOLLOWER
Aug 06 11:50:14 dist-test-slave-7z32 krb5kdc[15637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:50:14.560335 15753 consensus_queue.cc:260] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:14.560535 15753 raft_consensus.cc:388] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:50:14.560631 15753 raft_consensus.cc:482] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:50:14.560757 15753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:50:14.561877 15753 raft_consensus.cc:504] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:14.562284 15753 leader_election.cc:302] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 699a4c6870f6433eb68a5fcd62d121a9; no voters:
I20260806 11:50:14.562682 15753 leader_election.cc:288] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:50:14.562939 15759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:50:14.563344 15759 raft_consensus.cc:686] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 1 LEADER]: Becoming Leader. State: Replica: 699a4c6870f6433eb68a5fcd62d121a9, State: Running, Role: LEADER
I20260806 11:50:14.563926 15759 consensus_queue.cc:237] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:14.564301 15753 sys_catalog.cc:564] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:50:14.566215 15762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 699a4c6870f6433eb68a5fcd62d121a9. Latest consensus state: current_term: 1 leader_uuid: "699a4c6870f6433eb68a5fcd62d121a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } } }
I20260806 11:50:14.566387 15762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: This master's current role is: LEADER
I20260806 11:50:14.566756 15760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "699a4c6870f6433eb68a5fcd62d121a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } } }
I20260806 11:50:14.566890 15760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: This master's current role is: LEADER
I20260806 11:50:14.568819 15757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:14.550085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46308 (local address 127.26.172.254:46223)
0806 11:50:14.550721 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:14.550744 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:14.550796 (+ 52us) server_negotiation.cc:407] Connection header received
0806 11:50:14.551853 (+ 1057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:14.551879 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:14.552339 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:14.552723 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:14.553825 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:14.555412 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:14.556773 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:14.557393 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:14.557548 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:14.561101 (+ 3553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:14.561108 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:14.561130 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:14.561171 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:14.563910 (+ 2739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:14.564591 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:14.564598 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:14.564606 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:14.564798 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:14.565175 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:14.565179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:14.565181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:14.565881 (+ 700us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:14.566128 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:14.567035 (+ 907us) server_negotiation.cc:299] Negotiation successful
0806 11:50:14.567477 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":212,"threads_started":1}
W20260806 11:50:14.570525 15778 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:50:14.570627 15778 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:50:14.570715 15775 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:50:14.571579 15775 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:50:14.578665 15775 catalog_manager.cc:1347] Generated new cluster ID: 9576fb8ff1214986acb4522ea60470b3
I20260806 11:50:14.578796 15775 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:50:14.588819 15775 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:50:14.590145 15775 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:50:14.598501 15775 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Generated new TSK 0
I20260806 11:50:14.599602 15775 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:50:14.649384 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46223
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:50:14.813400 15786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:14.813839 15786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:14.813933 15786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:14.818706 15786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:14.818883 15786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:14.819036 15786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:50:14.826341 15786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:14.828143 15786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:14.829600 15786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:50:14.843554 15798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:14.843657 15796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:14.843777 15786 server_base.cc:1034] running on GCE node
W20260806 11:50:14.843554 15793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:14.844764 15786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:14.845742 15786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:14.847013 15786 hybrid_clock.cc:648] HybridClock initialized: now 1786017014846986 us; error 40 us; skew 500 ppm
Aug 06 11:50:14 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017014, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:14.851495 15786 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:50:14.852943 15786 webserver.cc:460] Webserver started at http://127.26.172.193:33735/ using document root <none> and password file <none>
I20260806 11:50:14.853931 15786 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:14.854038 15786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:14.854357 15786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:50:14.857980 15786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "ba9a70f5efd0434286d987be5355339e"
format_stamp: "Formatted at 2026-08-06 11:50:14 on dist-test-slave-7z32"
server_key: "470c9d4654c9b425e8896c9aaf8510bd"
server_key_iv: "7f171247e066ce6a230da20ca60728fa"
server_key_version: "encryptionkey@0"
I20260806 11:50:14.858937 15786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "ba9a70f5efd0434286d987be5355339e"
format_stamp: "Formatted at 2026-08-06 11:50:14 on dist-test-slave-7z32"
server_key: "470c9d4654c9b425e8896c9aaf8510bd"
server_key_iv: "7f171247e066ce6a230da20ca60728fa"
server_key_version: "encryptionkey@0"
I20260806 11:50:14.864802 15786 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:50:14.868670 15814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:14.870579 15786 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 11:50:14.871157 15786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "ba9a70f5efd0434286d987be5355339e"
format_stamp: "Formatted at 2026-08-06 11:50:14 on dist-test-slave-7z32"
server_key: "470c9d4654c9b425e8896c9aaf8510bd"
server_key_iv: "7f171247e066ce6a230da20ca60728fa"
server_key_version: "encryptionkey@0"
I20260806 11:50:14.871423 15786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:14.906381 15786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:14.911381 15786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:14.911623 15786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:14.912432 15786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:50:14.913673 15786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:50:14.913771 15786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:14.913863 15786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:50:14.913923 15786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:14.927351 15786 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:42599
I20260806 11:50:14.927433 15982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:42599 every 8 connection(s)
I20260806 11:50:14.928684 15786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:50:14.935532 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 15786
I20260806 11:50:14.935702 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:50:14.936100 27315 external_mini_cluster.cc:1428] Setting key 6d26b76c7ee39e0fc2a346b085af3a97
Aug 06 11:50:14 dist-test-slave-7z32 krb5kdc[15637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017014, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:50:14.949355 15757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:14.931521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:53711 (local address 127.26.172.254:46223)
0806 11:50:14.931790 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:14.931797 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:14.933100 (+ 1303us) server_negotiation.cc:407] Connection header received
0806 11:50:14.935110 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:14.935115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:14.935215 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:14.935364 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:14.937281 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:14.938146 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:14.939653 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:14.940106 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:14.940260 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:14.943978 (+ 3718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:14.943982 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:14.943985 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:14.944023 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:14.945891 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:14.946768 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:14.946772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:14.946773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:14.946951 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:14.947491 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:14.947495 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:14.947498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:14.947878 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:14.948049 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:14.948932 (+ 883us) server_negotiation.cc:299] Negotiation successful
0806 11:50:14.949130 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:50:14.950801 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:14.932158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:53711)
0806 11:50:14.932852 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:14.932934 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:14.934486 (+ 1552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:14.935679 (+ 1193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:14.935691 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:14.936309 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:50:14.937050 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:14.937071 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:14.938341 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:14.938344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:14.939479 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:14.939491 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:14.940313 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:14.940316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:14.940512 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:14.941359 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:50:14.941432 (+ 73us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:50:14.943709 (+ 2277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:50:14.946061 (+ 2352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:14.946073 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:14.946097 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:14.946578 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:14.947071 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:14.947074 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:14.947078 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:14.947311 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:14.948167 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:50:14.948177 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:50:14.948587 (+ 410us) client_negotiation.cc:769] Sending connection context
0806 11:50:14.948867 (+ 280us) client_negotiation.cc:240] Negotiation successful
0806 11:50:14.949375 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":191,"threads_started":1}
I20260806 11:50:14.953095 15983 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46223
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:50:14.953544 15983 heartbeater.cc:464] Registering TS with master...
I20260806 11:50:14.954320 15983 heartbeater.cc:511] Master 127.26.172.254:46223 requested a full tablet report, sending...
I20260806 11:50:14.956787 15699 ts_manager.cc:194] Registered new tserver with Master: ba9a70f5efd0434286d987be5355339e (127.26.172.193:42599)
I20260806 11:50:14.958289 15699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:53711
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:50:14.975803 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46223
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:50:15.118136 15989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:15.118467 15989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:15.118515 15989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:15.122705 15989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:15.122797 15989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:15.122882 15989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:50:15.128593 15989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:15.129830 15989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:15.130954 15989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:50:15.142467 15999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:15.142482 16001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:15.142621 15989 server_base.cc:1034] running on GCE node
W20260806 11:50:15.142795 16004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:15.143329 15989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:15.144136 15989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:15.145371 15989 hybrid_clock.cc:648] HybridClock initialized: now 1786017015145351 us; error 40 us; skew 500 ppm
Aug 06 11:50:15 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017015, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:15.148855 15989 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:50:15.149996 15989 webserver.cc:460] Webserver started at http://127.26.172.194:37517/ using document root <none> and password file <none>
I20260806 11:50:15.150632 15989 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:15.150707 15989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:15.150987 15989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:50:15.153229 15989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "33dd6cb58ff24e48a626f9717135d490"
format_stamp: "Formatted at 2026-08-06 11:50:15 on dist-test-slave-7z32"
server_key: "af46cbd8f1fa727af6f88d67c4508968"
server_key_iv: "e7bc68867626c86ab5a1f7d761fc5c8b"
server_key_version: "encryptionkey@0"
I20260806 11:50:15.153815 15989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "33dd6cb58ff24e48a626f9717135d490"
format_stamp: "Formatted at 2026-08-06 11:50:15 on dist-test-slave-7z32"
server_key: "af46cbd8f1fa727af6f88d67c4508968"
server_key_iv: "e7bc68867626c86ab5a1f7d761fc5c8b"
server_key_version: "encryptionkey@0"
I20260806 11:50:15.158403 15989 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260806 11:50:15.161729 16012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:15.163586 15989 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 11:50:15.163750 15989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "33dd6cb58ff24e48a626f9717135d490"
format_stamp: "Formatted at 2026-08-06 11:50:15 on dist-test-slave-7z32"
server_key: "af46cbd8f1fa727af6f88d67c4508968"
server_key_iv: "e7bc68867626c86ab5a1f7d761fc5c8b"
server_key_version: "encryptionkey@0"
I20260806 11:50:15.163880 15989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:15.178498 15989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:15.182186 15989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:15.182372 15989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:15.183050 15989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:50:15.184042 15989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:50:15.184120 15989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:15.184190 15989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:50:15.184245 15989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:15.195657 15989 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:37745
I20260806 11:50:15.195722 16178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:37745 every 8 connection(s)
I20260806 11:50:15.196794 15989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:50:15.197422 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 15989
I20260806 11:50:15.197605 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:50:15.197939 27315 external_mini_cluster.cc:1428] Setting key 856ce1f2dbd05850dcd2a74dee7aa342
Aug 06 11:50:15 dist-test-slave-7z32 krb5kdc[15637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017015, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:50:15.215204 15757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.199816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:58095 (local address 127.26.172.254:46223)
0806 11:50:15.200007 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:15.200013 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:15.201463 (+ 1450us) server_negotiation.cc:407] Connection header received
0806 11:50:15.203043 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:15.203047 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:15.203113 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:15.203224 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:15.204577 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.205148 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.206327 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.206550 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.206666 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.210379 (+ 3713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:15.210383 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:15.210385 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:15.210412 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:15.212186 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:15.212958 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:15.212963 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:15.212965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:15.213090 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:15.213605 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:15.213609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:15.213610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:15.213865 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:15.213996 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:15.214730 (+ 734us) server_negotiation.cc:299] Negotiation successful
0806 11:50:15.214995 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:50:15.216500 16182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.200510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:58095)
0806 11:50:15.201262 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:15.201333 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:15.202716 (+ 1383us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:15.203485 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:15.203492 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:15.203897 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:50:15.204426 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.204439 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.205281 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.205289 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.206188 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.206197 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.206718 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.206722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.206973 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.207645 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:50:15.207663 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:50:15.210056 (+ 2393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:50:15.212360 (+ 2304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:15.212368 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:15.212389 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:15.212744 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:15.213258 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:15.213263 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:15.213265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:15.213468 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:15.213996 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:50:15.214005 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:50:15.214389 (+ 384us) client_negotiation.cc:769] Sending connection context
0806 11:50:15.214687 (+ 298us) client_negotiation.cc:240] Negotiation successful
0806 11:50:15.215227 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":218,"threads_started":1}
I20260806 11:50:15.218379 16179 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46223
I20260806 11:50:15.218752 16179 heartbeater.cc:464] Registering TS with master...
I20260806 11:50:15.219475 16179 heartbeater.cc:511] Master 127.26.172.254:46223 requested a full tablet report, sending...
I20260806 11:50:15.221092 15699 ts_manager.cc:194] Registered new tserver with Master: 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745)
I20260806 11:50:15.221882 15699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:58095
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:50:15.239933 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46223
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:50:15.364208 16188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:15.364611 16188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:15.364692 16188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:15.369606 16188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:15.369711 16188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:15.369812 16188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:50:15.375787 16188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:46223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:15.377190 16188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:15.378340 16188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:50:15.389922 16198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:15.390034 16188 server_base.cc:1034] running on GCE node
W20260806 11:50:15.389930 16201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:15.389951 16196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:15.390987 16188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:15.391901 16188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:15.393148 16188 hybrid_clock.cc:648] HybridClock initialized: now 1786017015393120 us; error 49 us; skew 500 ppm
Aug 06 11:50:15 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017015, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:15.397286 16188 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:50:15.398763 16188 webserver.cc:460] Webserver started at http://127.26.172.195:46817/ using document root <none> and password file <none>
I20260806 11:50:15.399614 16188 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:15.399698 16188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:15.399976 16188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:50:15.402726 16188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "172385f623074781a5ac9b3075d36b01"
format_stamp: "Formatted at 2026-08-06 11:50:15 on dist-test-slave-7z32"
server_key: "bc8dfb55b41283bdcc8796185278c1b1"
server_key_iv: "8cdc0617619b65fe953a92588602c8fe"
server_key_version: "encryptionkey@0"
I20260806 11:50:15.403486 16188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "172385f623074781a5ac9b3075d36b01"
format_stamp: "Formatted at 2026-08-06 11:50:15 on dist-test-slave-7z32"
server_key: "bc8dfb55b41283bdcc8796185278c1b1"
server_key_iv: "8cdc0617619b65fe953a92588602c8fe"
server_key_version: "encryptionkey@0"
I20260806 11:50:15.408995 16188 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:50:15.413152 16212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:15.415345 16188 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 11:50:15.415544 16188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "172385f623074781a5ac9b3075d36b01"
format_stamp: "Formatted at 2026-08-06 11:50:15 on dist-test-slave-7z32"
server_key: "bc8dfb55b41283bdcc8796185278c1b1"
server_key_iv: "8cdc0617619b65fe953a92588602c8fe"
server_key_version: "encryptionkey@0"
I20260806 11:50:15.415702 16188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:15.450348 16188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:15.454627 16188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:15.454900 16188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:15.455655 16188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:50:15.456694 16188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:50:15.456750 16188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:15.456799 16188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:50:15.456815 16188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:15.470031 16188 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:46363
I20260806 11:50:15.470124 16390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:46363 every 8 connection(s)
I20260806 11:50:15.471413 16188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:50:15.471714 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 16188
I20260806 11:50:15.471885 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:50:15.472333 27315 external_mini_cluster.cc:1428] Setting key 96a7d17f9e38a997e6adbc327852eb9b
Aug 06 11:50:15 dist-test-slave-7z32 krb5kdc[15637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017015, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:50:15.489785 15757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.474032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:55239 (local address 127.26.172.254:46223)
0806 11:50:15.474246 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:15.474271 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:15.476094 (+ 1823us) server_negotiation.cc:407] Connection header received
0806 11:50:15.477365 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:15.477368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:15.477436 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:15.477521 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:15.479202 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.479813 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.481288 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.481553 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.481730 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.484968 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:15.484972 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:15.484975 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:15.485013 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:15.486878 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:15.487540 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:15.487545 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:15.487546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:15.487747 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:15.488362 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:15.488366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:15.488368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:15.488626 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:15.488752 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:15.489421 (+ 669us) server_negotiation.cc:299] Negotiation successful
0806 11:50:15.489595 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260806 11:50:15.491056 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.474561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:55239)
0806 11:50:15.475903 (+ 1342us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:15.475963 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:15.477115 (+ 1152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:15.477750 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:15.477758 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:15.478236 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:50:15.479037 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.479063 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.479959 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.479963 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.480960 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.480969 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.481744 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.481749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.481966 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.482739 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:50:15.482760 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:50:15.484747 (+ 1987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:50:15.487021 (+ 2274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:15.487027 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:15.487046 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:15.487354 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:15.487990 (+ 636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:15.487994 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:15.487998 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:15.488233 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:15.488760 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:50:15.488770 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:50:15.489116 (+ 346us) client_negotiation.cc:769] Sending connection context
0806 11:50:15.489364 (+ 248us) client_negotiation.cc:240] Negotiation successful
0806 11:50:15.489887 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1066,"thread_start_us":876,"threads_started":1}
I20260806 11:50:15.492641 16391 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46223
I20260806 11:50:15.493067 16391 heartbeater.cc:464] Registering TS with master...
I20260806 11:50:15.493788 16391 heartbeater.cc:511] Master 127.26.172.254:46223 requested a full tablet report, sending...
I20260806 11:50:15.495265 15699 ts_manager.cc:194] Registered new tserver with Master: 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363)
I20260806 11:50:15.496021 15699 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:55239
I20260806 11:50:15.500968 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:50:15.512871 15757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.503923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46312 (local address 127.26.172.254:46223)
0806 11:50:15.504167 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:15.504173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:15.504311 (+ 138us) server_negotiation.cc:407] Connection header received
0806 11:50:15.504521 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:15.504525 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:15.504594 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:15.504691 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:15.505545 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.506136 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.507131 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.507366 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.507484 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.509178 (+ 1694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:15.509183 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:15.509186 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:15.509223 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:15.510911 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:15.511402 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:15.511406 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:15.511408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:15.511505 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:15.511806 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:15.511809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:15.511811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:15.512108 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:15.512267 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:15.512518 (+ 251us) server_negotiation.cc:299] Negotiation successful
0806 11:50:15.512665 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 11:50:15.517583 15699 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:50:15.522248 15699 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:50:15.544067 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.536614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42599 (local address 127.0.0.1:42912)
0806 11:50:15.536995 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:15.537012 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:15.537165 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:15.538238 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:15.538242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:15.538281 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:15.538400 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.538405 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.540199 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.540205 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.541768 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.541781 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.543372 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.543376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.543505 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.543547 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 11:50:15.543668 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 11:50:15.543871 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":64,"thread_start_us":125,"threads_started":1}
I20260806 11:50:15.544152 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.535154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44132 (local address 127.26.172.194:37745)
0806 11:50:15.536471 (+ 1317us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:15.536486 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:15.536972 (+ 486us) server_negotiation.cc:407] Connection header received
0806 11:50:15.537086 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:15.537092 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:15.537365 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:15.537570 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:15.538585 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.539832 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.541976 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.543027 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.543167 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.543356 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:15.543829 (+ 473us) server_negotiation.cc:299] Negotiation successful
0806 11:50:15.543958 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1180,"thread_start_us":216,"threads_started":1}
I20260806 11:50:15.544800 16409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.535420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:46363 (local address 127.0.0.1:58082)
0806 11:50:15.536810 (+ 1390us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:15.536827 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:15.536907 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:15.537720 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:15.537728 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:15.537777 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:15.538001 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.538011 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.540675 (+ 2664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.540679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.541991 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.542001 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.544295 (+ 2294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.544303 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.544415 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.544442 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 11:50:15.544505 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 11:50:15.544628 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1306,"mutex_wait_us":37,"thread_start_us":111,"threads_started":1}
I20260806 11:50:15.545132 16413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.536095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58082 (local address 127.26.172.195:46363)
0806 11:50:15.537196 (+ 1101us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:15.537210 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:15.537232 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:50:15.537313 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:15.537318 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:15.537502 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:15.537992 (+ 490us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:15.538178 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.540496 (+ 2318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.543197 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.544120 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.544623 (+ 503us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.544780 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:15.544842 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 11:50:15.544959 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":989,"thread_start_us":215,"threads_started":1}
I20260806 11:50:15.545293 16411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.534847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37745 (local address 127.0.0.1:44132)
0806 11:50:15.536534 (+ 1687us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:15.536599 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:15.536766 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:15.537794 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:15.537797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:15.537811 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:15.538168 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.538174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.540008 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.540013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.541804 (+ 1791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.541818 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.543434 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.543438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.543566 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.543598 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 11:50:15.543685 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 11:50:15.545116 (+ 1431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":936,"mutex_wait_us":863,"spinlock_wait_cycles":768,"thread_start_us":130,"threads_started":1}
I20260806 11:50:15.545812 16412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.535901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42912 (local address 127.26.172.193:42599)
0806 11:50:15.537457 (+ 1556us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:15.537465 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:15.537494 (+ 29us) server_negotiation.cc:407] Connection header received
0806 11:50:15.537592 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:15.537598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:15.537843 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:15.538047 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:15.538542 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.539856 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.541942 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.542944 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.543119 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.543298 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:15.545490 (+ 2192us) server_negotiation.cc:299] Negotiation successful
0806 11:50:15.545641 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1438,"thread_start_us":145,"threads_started":1}
I20260806 11:50:15.549273 16286 tablet_service.cc:1467] Processing CreateTablet for tablet 3a844e77077f48de9ee1bb0bdb7ed174 (DEFAULT_TABLE table=test-table [id=d2b6a3856ab441c7b3164ae6a49dc728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:50:15.549609 15881 tablet_service.cc:1467] Processing CreateTablet for tablet 3a844e77077f48de9ee1bb0bdb7ed174 (DEFAULT_TABLE table=test-table [id=d2b6a3856ab441c7b3164ae6a49dc728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:50:15.550935 16286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a844e77077f48de9ee1bb0bdb7ed174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:50:15.549270 16083 tablet_service.cc:1467] Processing CreateTablet for tablet 3a844e77077f48de9ee1bb0bdb7ed174 (DEFAULT_TABLE table=test-table [id=d2b6a3856ab441c7b3164ae6a49dc728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:50:15.551402 15881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a844e77077f48de9ee1bb0bdb7ed174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:50:15.551633 16083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a844e77077f48de9ee1bb0bdb7ed174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:50:15.559947 16415 tablet_bootstrap.cc:492] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Bootstrap starting.
I20260806 11:50:15.561466 16417 tablet_bootstrap.cc:492] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: Bootstrap starting.
I20260806 11:50:15.562077 16416 tablet_bootstrap.cc:492] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: Bootstrap starting.
I20260806 11:50:15.563463 16415 tablet_bootstrap.cc:654] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Neither blocks nor log segments found. Creating new log.
I20260806 11:50:15.564105 16417 tablet_bootstrap.cc:654] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: Neither blocks nor log segments found. Creating new log.
I20260806 11:50:15.564805 16415 log.cc:824] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Log is configured to *not* fsync() on all Append() calls
I20260806 11:50:15.565389 16416 tablet_bootstrap.cc:654] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: Neither blocks nor log segments found. Creating new log.
I20260806 11:50:15.565541 16417 log.cc:824] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: Log is configured to *not* fsync() on all Append() calls
I20260806 11:50:15.566365 16416 log.cc:824] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: Log is configured to *not* fsync() on all Append() calls
I20260806 11:50:15.568158 16415 tablet_bootstrap.cc:492] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: No bootstrap required, opened a new log
I20260806 11:50:15.568450 16415 ts_tablet_manager.cc:1397] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 11:50:15.568490 16417 tablet_bootstrap.cc:492] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: No bootstrap required, opened a new log
I20260806 11:50:15.568670 16416 tablet_bootstrap.cc:492] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: No bootstrap required, opened a new log
I20260806 11:50:15.568774 16417 ts_tablet_manager.cc:1397] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260806 11:50:15.568845 16416 ts_tablet_manager.cc:1397] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260806 11:50:15.572949 16415 raft_consensus.cc:348] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:15.573238 16415 raft_consensus.cc:374] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:50:15.573295 16415 raft_consensus.cc:729] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9a70f5efd0434286d987be5355339e, State: Initialized, Role: FOLLOWER
I20260806 11:50:15.573496 16416 raft_consensus.cc:348] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:15.573496 16417 raft_consensus.cc:348] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:15.573874 16416 raft_consensus.cc:374] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:50:15.573874 16417 raft_consensus.cc:374] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:50:15.573798 16415 consensus_queue.cc:260] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:15.573943 16417 raft_consensus.cc:729] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 172385f623074781a5ac9b3075d36b01, State: Initialized, Role: FOLLOWER
I20260806 11:50:15.573952 16416 raft_consensus.cc:729] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33dd6cb58ff24e48a626f9717135d490, State: Initialized, Role: FOLLOWER
I20260806 11:50:15.574529 16417 consensus_queue.cc:260] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:15.574529 16416 consensus_queue.cc:260] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:15.574618 15983 heartbeater.cc:503] Master 127.26.172.254:46223 was elected leader, sending a full tablet report...
I20260806 11:50:15.575037 16415 ts_tablet_manager.cc:1428] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 11:50:15.575767 16417 ts_tablet_manager.cc:1428] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260806 11:50:15.575767 16416 ts_tablet_manager.cc:1428] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260806 11:50:15.576202 16391 heartbeater.cc:503] Master 127.26.172.254:46223 was elected leader, sending a full tablet report...
I20260806 11:50:15.576202 16179 heartbeater.cc:503] Master 127.26.172.254:46223 was elected leader, sending a full tablet report...
I20260806 11:50:15.582798 16423 raft_consensus.cc:482] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:50:15.583132 16423 raft_consensus.cc:504] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:15.584525 16423 leader_election.cc:288] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363), ba9a70f5efd0434286d987be5355339e (127.26.172.193:42599)
I20260806 11:50:15.589468 16424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.584887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:46363 (local address 127.26.172.194:38735)
0806 11:50:15.585326 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:15.585341 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:15.585445 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:15.585939 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:15.585942 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:15.585959 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:15.586103 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.586109 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.587134 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.587137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.588128 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.588138 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.588966 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.588970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.589083 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.589104 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 11:50:15.589199 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 11:50:15.589296 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":81,"thread_start_us":170,"threads_started":1}
I20260806 11:50:15.589447 16413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.585543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:38735 (local address 127.26.172.195:46363)
0806 11:50:15.585719 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:15.585724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:15.585737 (+ 13us) server_negotiation.cc:407] Connection header received
0806 11:50:15.585790 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:15.585793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:15.585831 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:15.585922 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:15.586219 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.587019 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.588266 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.588828 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.588969 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.589028 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:15.589219 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 11:50:15.589301 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 11:50:15.589985 16182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.584887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42599 (local address 127.26.172.194:53549)
0806 11:50:15.585185 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:15.585207 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:15.585352 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:15.586424 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:15.586428 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:15.586449 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:15.586551 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.586557 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.587485 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.587491 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.588360 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:15.588371 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.589482 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.589486 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:15.589596 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.589632 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 11:50:15.589720 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 11:50:15.589834 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":30}
I20260806 11:50:15.590319 16412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.585965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:53549 (local address 127.26.172.193:42599)
0806 11:50:15.586144 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:15.586148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:15.586164 (+ 16us) server_negotiation.cc:407] Connection header received
0806 11:50:15.586247 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:15.586249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:15.586294 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:15.586375 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:15.586676 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.587335 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.588522 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.589161 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.589322 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.589401 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:15.590087 (+ 686us) server_negotiation.cc:299] Negotiation successful
0806 11:50:15.590197 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 11:50:15.590243 16314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a844e77077f48de9ee1bb0bdb7ed174" candidate_uuid: "33dd6cb58ff24e48a626f9717135d490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "172385f623074781a5ac9b3075d36b01" is_pre_election: true
I20260806 11:50:15.590631 16314 raft_consensus.cc:2454] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33dd6cb58ff24e48a626f9717135d490 in term 0.
I20260806 11:50:15.591128 15910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a844e77077f48de9ee1bb0bdb7ed174" candidate_uuid: "33dd6cb58ff24e48a626f9717135d490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9a70f5efd0434286d987be5355339e" is_pre_election: true
I20260806 11:50:15.591290 16015 leader_election.cc:302] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 172385f623074781a5ac9b3075d36b01, 33dd6cb58ff24e48a626f9717135d490; no voters:
I20260806 11:50:15.591524 15910 raft_consensus.cc:2454] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33dd6cb58ff24e48a626f9717135d490 in term 0.
I20260806 11:50:15.591662 16423 raft_consensus.cc:2781] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:50:15.591761 16423 raft_consensus.cc:482] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:50:15.591842 16423 raft_consensus.cc:3037] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:50:15.593182 16423 raft_consensus.cc:504] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:15.593611 16423 leader_election.cc:288] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [CANDIDATE]: Term 1 election: Requested vote from peers 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363), ba9a70f5efd0434286d987be5355339e (127.26.172.193:42599)
I20260806 11:50:15.594123 16314 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a844e77077f48de9ee1bb0bdb7ed174" candidate_uuid: "33dd6cb58ff24e48a626f9717135d490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "172385f623074781a5ac9b3075d36b01"
I20260806 11:50:15.594326 16314 raft_consensus.cc:3037] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:50:15.594437 15910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a844e77077f48de9ee1bb0bdb7ed174" candidate_uuid: "33dd6cb58ff24e48a626f9717135d490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9a70f5efd0434286d987be5355339e"
I20260806 11:50:15.594664 15910 raft_consensus.cc:3037] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:50:15.595665 16314 raft_consensus.cc:2454] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33dd6cb58ff24e48a626f9717135d490 in term 1.
I20260806 11:50:15.596107 16015 leader_election.cc:302] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 172385f623074781a5ac9b3075d36b01, 33dd6cb58ff24e48a626f9717135d490; no voters:
I20260806 11:50:15.596441 16423 raft_consensus.cc:2781] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:50:15.596448 15910 raft_consensus.cc:2454] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33dd6cb58ff24e48a626f9717135d490 in term 1.
I20260806 11:50:15.596818 16423 raft_consensus.cc:686] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 1 LEADER]: Becoming Leader. State: Replica: 33dd6cb58ff24e48a626f9717135d490, State: Running, Role: LEADER
I20260806 11:50:15.597259 16423 consensus_queue.cc:237] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:15.601260 15696 catalog_manager.cc:5495] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194). New cstate: current_term: 1 leader_uuid: "33dd6cb58ff24e48a626f9717135d490" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260806 11:50:15.631338 16410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.626351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44140 (local address 127.26.172.194:37745)
0806 11:50:15.626673 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:15.626683 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:15.626713 (+ 30us) server_negotiation.cc:407] Connection header received
0806 11:50:15.626911 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:15.626916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:15.627024 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:15.627218 (+ 194us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:50:15.627661 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.628230 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.629220 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:15.629466 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:15.629604 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:15.630021 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:50:15.630799 (+ 778us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:50:15.631005 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:15.631052 (+ 47us) server_negotiation.cc:299] Negotiation successful
0806 11:50:15.631136 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 11:50:15.640636 16314 raft_consensus.cc:1261] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01 [term 1 FOLLOWER]: Refusing update from remote peer 33dd6cb58ff24e48a626f9717135d490: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:50:15.640668 15910 raft_consensus.cc:1261] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Refusing update from remote peer 33dd6cb58ff24e48a626f9717135d490: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:50:15.641546 16423 consensus_queue.cc:1035] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:50:15.641855 16425 consensus_queue.cc:1035] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:50:15.656715 16430 mvcc.cc:205] Tried to move back new op lower bound from 7315525696051384320 to 7315525695889448960. Current Snapshot: MvccSnapshot[applied={T|T < 7315525696051384320}]
I20260806 11:50:15.663280 15696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:50:15.663586 15696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:50:15.667382 15696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Sending DeleteTablet for 3 replicas of tablet 3a844e77077f48de9ee1bb0bdb7ed174
I20260806 11:50:15.668449 16286 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a844e77077f48de9ee1bb0bdb7ed174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:50:15 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:58082
I20260806 11:50:15.668560 16083 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a844e77077f48de9ee1bb0bdb7ed174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:50:15 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:44132
I20260806 11:50:15.668737 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 15786
I20260806 11:50:15.682353 16447 tablet_replica.cc:330] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: stopping tablet replica
I20260806 11:50:15.683128 16447 raft_consensus.cc:2229] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:50:15.683947 16447 raft_consensus.cc:2258] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:50:15.687944 16447 ts_tablet_manager.cc:1905] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:50:15.688148 16446 tablet_replica.cc:330] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: stopping tablet replica
I20260806 11:50:15.688563 16446 raft_consensus.cc:2229] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:50:15.688993 16446 raft_consensus.cc:2258] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:50:15.691779 16447 ts_tablet_manager.cc:1918] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:50:15.691924 16447 log.cc:1196] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/3a844e77077f48de9ee1bb0bdb7ed174
I20260806 11:50:15.691823 16446 ts_tablet_manager.cc:1905] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:50:15.692313 16447 ts_tablet_manager.cc:1939] T 3a844e77077f48de9ee1bb0bdb7ed174 P 33dd6cb58ff24e48a626f9717135d490: Deleting consensus metadata
I20260806 11:50:15.693996 15677 catalog_manager.cc:4841] TS 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745): tablet 3a844e77077f48de9ee1bb0bdb7ed174 (table test-table [id=d2b6a3856ab441c7b3164ae6a49dc728]) successfully deleted
I20260806 11:50:15.696337 16446 ts_tablet_manager.cc:1918] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:50:15.696509 16446 log.cc:1196] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/3a844e77077f48de9ee1bb0bdb7ed174
I20260806 11:50:15.696931 16446 ts_tablet_manager.cc:1939] T 3a844e77077f48de9ee1bb0bdb7ed174 P 172385f623074781a5ac9b3075d36b01: Deleting consensus metadata
I20260806 11:50:15.699072 15679 catalog_manager.cc:4841] TS 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363): tablet 3a844e77077f48de9ee1bb0bdb7ed174 (table test-table [id=d2b6a3856ab441c7b3164ae6a49dc728]) successfully deleted
W20260806 11:50:15.699395 15681 connection.cc:535] client connection to 127.26.172.193:42599 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 11:50:15.699476 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 15989
W20260806 11:50:15.699563 15681 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 11:50:15.707810 16411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:15.707327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42599 (local address 127.0.0.1:42922)
0806 11:50:15.707554 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:15.707674 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:42599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 11:50:15.708070 15681 catalog_manager.cc:4584] TS ba9a70f5efd0434286d987be5355339e (127.26.172.193:42599): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3a844e77077f48de9ee1bb0bdb7ed174: Network error: Client connection negotiation failed: client connection to 127.26.172.193:42599: connect: Connection refused (error 111)
I20260806 11:50:15.718003 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 16188
I20260806 11:50:15.731158 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 15654
I20260806 11:50:35.751197 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46223
--webserver_interface=127.26.172.254
--webserver_port=40769
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:46223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:50:35.910487 16450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:35.911047 16450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:35.911154 16450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:35.919911 16450 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 11:50:35.920042 16450 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 11:50:35.920080 16450 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 11:50:35.920112 16450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:50:35.920154 16450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:35.920200 16450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:35.920238 16450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:50:35.920274 16450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:50:35.928423 16450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:46223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=40769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:35.930207 16450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:35.931787 16450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 11:50:35.952304 16450 server_base.cc:1034] running on GCE node
W20260806 11:50:35.952236 16459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:35.952234 16461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:35.952234 16458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:35.953639 16450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:35.955165 16450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:35.956372 16450 hybrid_clock.cc:648] HybridClock initialized: now 1786017035956359 us; error 45 us; skew 500 ppm
Aug 06 11:50:35 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017035, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:35.960363 16450 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:50:35.961651 16450 webserver.cc:460] Webserver started at http://127.26.172.254:40769/ using document root <none> and password file <none>
I20260806 11:50:35.962463 16450 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:35.962559 16450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:35.968238 16450 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:50:35.971447 16476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:35.973445 16450 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 11:50:35.973678 16450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "699a4c6870f6433eb68a5fcd62d121a9"
format_stamp: "Formatted at 2026-08-06 11:50:14 on dist-test-slave-7z32"
server_key: "b0d71af6c7b8420cce077350d8403faf"
server_key_iv: "3c30960d5f265acca9250fb3642bfad1"
server_key_version: "encryptionkey@0"
I20260806 11:50:35.974447 16450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:35.998514 16450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:36.002616 16450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:36.002936 16450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:36.012773 16450 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:46223
I20260806 11:50:36.013279 16556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:46223 every 8 connection(s)
I20260806 11:50:36.014247 16450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:50:36.015386 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 16450
I20260806 11:50:36.016063 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:42599
--local_ip_for_outbound_sockets=127.26.172.193
--tserver_master_addrs=127.26.172.254:46223
--webserver_port=33735
--webserver_interface=127.26.172.193
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:50:36.022118 16557 sys_catalog.cc:263] Verifying existing consensus state
I20260806 11:50:36.024650 16557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Bootstrap starting.
I20260806 11:50:36.048213 16557 log.cc:824] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Log is configured to *not* fsync() on all Append() calls
I20260806 11:50:36.060634 16557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:50:36.061254 16557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Bootstrap complete.
I20260806 11:50:36.066890 16557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:36.067461 16557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 699a4c6870f6433eb68a5fcd62d121a9, State: Initialized, Role: FOLLOWER
I20260806 11:50:36.068166 16557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:36.068363 16557 raft_consensus.cc:388] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:50:36.068456 16557 raft_consensus.cc:482] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:50:36.068591 16557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 1 FOLLOWER]: Advancing to term 2
I20260806 11:50:36.071395 16557 raft_consensus.cc:504] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:36.071849 16557 leader_election.cc:302] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 699a4c6870f6433eb68a5fcd62d121a9; no voters:
I20260806 11:50:36.072314 16557 leader_election.cc:288] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 11:50:36.072448 16564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 11:50:36.072716 16564 raft_consensus.cc:686] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 2 LEADER]: Becoming Leader. State: Replica: 699a4c6870f6433eb68a5fcd62d121a9, State: Running, Role: LEADER
I20260806 11:50:36.073118 16564 consensus_queue.cc:237] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:36.074009 16557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:50:36.074576 16564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 699a4c6870f6433eb68a5fcd62d121a9. Latest consensus state: current_term: 2 leader_uuid: "699a4c6870f6433eb68a5fcd62d121a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } } }
I20260806 11:50:36.074959 16564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: This master's current role is: LEADER
I20260806 11:50:36.076457 16565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "699a4c6870f6433eb68a5fcd62d121a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } } }
I20260806 11:50:36.076606 16565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: This master's current role is: LEADER
I20260806 11:50:36.076898 16579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:50:36.083431 16579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:50:36.084192 16579 catalog_manager.cc:1259] Loaded cluster ID: 9576fb8ff1214986acb4522ea60470b3
I20260806 11:50:36.084421 16579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:50:36.087616 16579 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:50:36.090577 16579 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Loaded TSK: 0
I20260806 11:50:36.114992 16579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Generated new TSK 1
I20260806 11:50:36.115444 16579 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 11:50:36.169907 16559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:36.170243 16559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:36.170329 16559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:36.174772 16559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:36.174932 16559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:36.175038 16559 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:50:36.181559 16559 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:42599
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=33735
--tserver_master_addrs=127.26.172.254:46223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:36.182986 16559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:36.184255 16559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:50:36.198242 16609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:36.198266 16606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:36.198242 16605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:36.199084 16559 server_base.cc:1034] running on GCE node
I20260806 11:50:36.199712 16559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:36.200567 16559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:36.201769 16559 hybrid_clock.cc:648] HybridClock initialized: now 1786017036201740 us; error 49 us; skew 500 ppm
Aug 06 11:50:36 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017036, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:36.206102 16559 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:50:36.207437 16559 webserver.cc:460] Webserver started at http://127.26.172.193:33735/ using document root <none> and password file <none>
I20260806 11:50:36.208112 16559 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:36.208247 16559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:36.212954 16559 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260806 11:50:36.215399 16623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:36.216830 16559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 11:50:36.216953 16559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "ba9a70f5efd0434286d987be5355339e"
format_stamp: "Formatted at 2026-08-06 11:50:14 on dist-test-slave-7z32"
server_key: "470c9d4654c9b425e8896c9aaf8510bd"
server_key_iv: "7f171247e066ce6a230da20ca60728fa"
server_key_version: "encryptionkey@0"
I20260806 11:50:36.217592 16559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:36.228559 16559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:36.232405 16559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:36.232647 16559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:36.233404 16559 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:50:36.234876 16633 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 11:50:36.239833 16559 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 11:50:36.239929 16559 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260806 11:50:36.240015 16559 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 11:50:36.242157 16559 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 11:50:36.242235 16559 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260806 11:50:36.242524 16633 tablet_bootstrap.cc:492] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Bootstrap starting.
I20260806 11:50:36.255978 16559 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:42599
I20260806 11:50:36.256224 16807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:42599 every 8 connection(s)
I20260806 11:50:36.257542 16559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:50:36.259558 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 16559
I20260806 11:50:36.260295 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:37745
--local_ip_for_outbound_sockets=127.26.172.194
--tserver_master_addrs=127.26.172.254:46223
--webserver_port=37517
--webserver_interface=127.26.172.194
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:50:36.269161 16633 log.cc:824] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Log is configured to *not* fsync() on all Append() calls
Aug 06 11:50:36 dist-test-slave-7z32 krb5kdc[15637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017036, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:50:36.280617 16633 tablet_bootstrap.cc:492] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:50:36.281270 16633 tablet_bootstrap.cc:492] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Bootstrap complete.
I20260806 11:50:36.283113 16633 ts_tablet_manager.cc:1397] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Time spent bootstrapping tablet: real 0.041s user 0.029s sys 0.010s
I20260806 11:50:36.283536 16811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.260648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:43725)
0806 11:50:36.261516 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:36.261575 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:36.262442 (+ 867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:36.264049 (+ 1607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:36.264071 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:36.264889 (+ 818us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:50:36.265862 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.265909 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.268551 (+ 2642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.268558 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.270028 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.270043 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.271154 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.271163 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.271512 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.272488 (+ 976us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:50:36.272519 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:50:36.274867 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:50:36.278891 (+ 4024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:36.278908 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:36.278927 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:36.279370 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:36.280081 (+ 711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:36.280084 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:36.280086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:36.280299 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:36.281241 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:50:36.281249 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:50:36.281657 (+ 408us) client_negotiation.cc:769] Sending connection context
0806 11:50:36.281915 (+ 258us) client_negotiation.cc:240] Negotiation successful
0806 11:50:36.282327 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":166,"threads_started":1}
I20260806 11:50:36.284197 16810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.260595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:43725 (local address 127.26.172.254:46223)
0806 11:50:36.261184 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.261207 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.262689 (+ 1482us) server_negotiation.cc:407] Connection header received
0806 11:50:36.263000 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.263010 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.263338 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.263735 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:36.266246 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.268298 (+ 2052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.270256 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.270903 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.271123 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.275358 (+ 4235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:36.275372 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:36.275402 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:36.275460 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:36.278533 (+ 3073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.279566 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.279576 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.279582 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.279926 (+ 344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.280434 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.280439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.280440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.281078 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:36.281243 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.282082 (+ 839us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.282518 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":151,"threads_started":1}
I20260806 11:50:36.286568 16633 raft_consensus.cc:348] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.287253 16633 raft_consensus.cc:729] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9a70f5efd0434286d987be5355339e, State: Initialized, Role: FOLLOWER
I20260806 11:50:36.287297 16808 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46223
I20260806 11:50:36.287585 16808 heartbeater.cc:464] Registering TS with master...
I20260806 11:50:36.287863 16633 consensus_queue.cc:260] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.288367 16808 heartbeater.cc:511] Master 127.26.172.254:46223 requested a full tablet report, sending...
I20260806 11:50:36.289181 16633 ts_tablet_manager.cc:1428] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 11:50:36.292062 16503 ts_manager.cc:194] Registered new tserver with Master: ba9a70f5efd0434286d987be5355339e (127.26.172.193:42599)
I20260806 11:50:36.297127 16503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:43725
I20260806 11:50:36.300536 16808 heartbeater.cc:503] Master 127.26.172.254:46223 was elected leader, sending a full tablet report...
Aug 06 11:50:36 dist-test-slave-7z32 krb5kdc[15637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017035, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.193@KRBTEST.COM
I20260806 11:50:36.309638 16818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.296358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51942 (local address 127.26.172.193:42599)
0806 11:50:36.297460 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.297472 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.297498 (+ 26us) server_negotiation.cc:407] Connection header received
0806 11:50:36.297583 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.297588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.297795 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.297980 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:36.298946 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.300056 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.301277 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.301793 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.301922 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.305166 (+ 3244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:36.305177 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:36.305192 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:36.305221 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:36.307285 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.307881 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.307887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.307888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.307982 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.308300 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.308304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.308306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.308643 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:36.308813 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.309217 (+ 404us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.309415 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":960,"thread_start_us":164,"threads_started":1}
I20260806 11:50:36.309639 16816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.296243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42599 (local address 127.0.0.1:51942)
0806 11:50:36.296858 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:36.296919 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:36.297119 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:36.297981 (+ 862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:36.297989 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:36.298620 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:50:36.298775 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.298783 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.300213 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.300220 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.301092 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.301105 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.301934 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.301937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.302062 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.302951 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:50:36.302967 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:50:36.304973 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:50:36.307418 (+ 2445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:36.307432 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:36.307440 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:36.307721 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:36.308094 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:36.308097 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:36.308099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:36.308199 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:36.308776 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:50:36.308784 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:50:36.308946 (+ 162us) client_negotiation.cc:769] Sending connection context
0806 11:50:36.309123 (+ 177us) client_negotiation.cc:240] Negotiation successful
0806 11:50:36.309414 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":204,"threads_started":1}
I20260806 11:50:36.311309 16702 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a844e77077f48de9ee1bb0bdb7ed174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:50:15 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:51942
I20260806 11:50:36.312512 16820 tablet_replica.cc:330] stopping tablet replica
I20260806 11:50:36.312971 16820 raft_consensus.cc:2229] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:50:36.313295 16820 raft_consensus.cc:2258] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:50:36.314656 16820 ts_tablet_manager.cc:1905] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:50:36.320129 16820 ts_tablet_manager.cc:1918] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:50:36.320276 16820 log.cc:1196] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal/wals/3a844e77077f48de9ee1bb0bdb7ed174
I20260806 11:50:36.320586 16820 ts_tablet_manager.cc:1939] T 3a844e77077f48de9ee1bb0bdb7ed174 P ba9a70f5efd0434286d987be5355339e: Deleting consensus metadata
I20260806 11:50:36.323168 16488 catalog_manager.cc:4841] TS ba9a70f5efd0434286d987be5355339e (127.26.172.193:42599): tablet 3a844e77077f48de9ee1bb0bdb7ed174 (table test-table [id=d2b6a3856ab441c7b3164ae6a49dc728]) successfully deleted
W20260806 11:50:36.401067 16812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:36.401363 16812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:36.401415 16812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:36.405778 16812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:36.405857 16812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:36.405921 16812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:50:36.414758 16812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:37745
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=37517
--tserver_master_addrs=127.26.172.254:46223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:36.416373 16812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:36.417835 16812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:50:36.429198 16827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:36.429289 16830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:36.429200 16826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:36.429519 16812 server_base.cc:1034] running on GCE node
I20260806 11:50:36.430173 16812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:36.431206 16812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:36.432405 16812 hybrid_clock.cc:648] HybridClock initialized: now 1786017036432381 us; error 50 us; skew 500 ppm
Aug 06 11:50:36 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017036, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:36.436233 16812 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:50:36.437376 16812 webserver.cc:460] Webserver started at http://127.26.172.194:37517/ using document root <none> and password file <none>
I20260806 11:50:36.437986 16812 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:36.438074 16812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:36.442528 16812 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260806 11:50:36.445145 16840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:36.446668 16812 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260806 11:50:36.446813 16812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "33dd6cb58ff24e48a626f9717135d490"
format_stamp: "Formatted at 2026-08-06 11:50:15 on dist-test-slave-7z32"
server_key: "af46cbd8f1fa727af6f88d67c4508968"
server_key_iv: "e7bc68867626c86ab5a1f7d761fc5c8b"
server_key_version: "encryptionkey@0"
I20260806 11:50:36.447469 16812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:36.480351 16812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:36.484356 16812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:36.484639 16812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:36.485337 16812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:50:36.486263 16812 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:50:36.486344 16812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:36.486433 16812 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:50:36.486480 16812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:36.497463 16812 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:37745
I20260806 11:50:36.497486 17013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:37745 every 8 connection(s)
I20260806 11:50:36.498602 16812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:50:36.503041 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 16812
I20260806 11:50:36.503619 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:46363
--local_ip_for_outbound_sockets=127.26.172.195
--tserver_master_addrs=127.26.172.254:46223
--webserver_port=46817
--webserver_interface=127.26.172.195
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:50:36 dist-test-slave-7z32 krb5kdc[15637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017036, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:50:36.516887 16810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.501221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:45523 (local address 127.26.172.254:46223)
0806 11:50:36.501431 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.501435 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.502693 (+ 1258us) server_negotiation.cc:407] Connection header received
0806 11:50:36.504459 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.504463 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.504534 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.504648 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:36.506019 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.506576 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.507974 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.508225 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.508344 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.511778 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:36.511781 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:36.511783 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:36.511813 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:36.513581 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.514541 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.514544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.514546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.514632 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.515223 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.515226 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.515227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.515478 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:36.515583 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.516558 (+ 975us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.516704 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 11:50:36.518658 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.501704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:45523)
0806 11:50:36.502494 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:36.502554 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:36.504199 (+ 1645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:36.504858 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:36.504866 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:36.505276 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:50:36.505817 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.505831 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.506717 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.506723 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.507824 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.507836 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.508428 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.508433 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.508612 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.509304 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:50:36.509322 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:50:36.511442 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:50:36.513761 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:36.513772 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:36.513800 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:36.514377 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:36.514749 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:36.514756 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:36.514761 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:36.515062 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:36.515624 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:50:36.515636 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:50:36.516154 (+ 518us) client_negotiation.cc:769] Sending connection context
0806 11:50:36.516479 (+ 325us) client_negotiation.cc:240] Negotiation successful
0806 11:50:36.517025 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":178,"threads_started":1}
I20260806 11:50:36.520485 17014 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46223
I20260806 11:50:36.520905 17014 heartbeater.cc:464] Registering TS with master...
I20260806 11:50:36.521607 17014 heartbeater.cc:511] Master 127.26.172.254:46223 requested a full tablet report, sending...
I20260806 11:50:36.522994 16503 ts_manager.cc:194] Registered new tserver with Master: 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745)
I20260806 11:50:36.523653 16503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:45523
W20260806 11:50:36.656700 17017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:36.657135 17017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:36.657224 17017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:36.661845 17017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:36.661981 17017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:36.662099 17017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:50:36.669023 17017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:46363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=46817
--tserver_master_addrs=127.26.172.254:46223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:36.670660 17017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:36.672073 17017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:50:36.685220 17024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:36.685230 17027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:36.685220 17025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:36.685647 17017 server_base.cc:1034] running on GCE node
I20260806 11:50:36.686352 17017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:36.687382 17017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:36.688602 17017 hybrid_clock.cc:648] HybridClock initialized: now 1786017036688579 us; error 39 us; skew 500 ppm
Aug 06 11:50:36 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017036, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:36.692318 17017 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:50:36.693710 17017 webserver.cc:460] Webserver started at http://127.26.172.195:46817/ using document root <none> and password file <none>
I20260806 11:50:36.694581 17017 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:36.694725 17017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:36.700201 17017 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:50:36.703287 17036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:36.705289 17017 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:50:36.705492 17017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "172385f623074781a5ac9b3075d36b01"
format_stamp: "Formatted at 2026-08-06 11:50:15 on dist-test-slave-7z32"
server_key: "bc8dfb55b41283bdcc8796185278c1b1"
server_key_iv: "8cdc0617619b65fe953a92588602c8fe"
server_key_version: "encryptionkey@0"
I20260806 11:50:36.706403 17017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:36.727021 17017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:36.731568 17017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:36.731853 17017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:36.732710 17017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:50:36.733872 17017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:50:36.733951 17017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:36.734032 17017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:50:36.734077 17017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:36.748765 17017 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:46363
I20260806 11:50:36.748939 17195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:46363 every 8 connection(s)
I20260806 11:50:36.750378 17017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:50:36.755667 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 17017
Aug 06 11:50:36 dist-test-slave-7z32 krb5kdc[15637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017036, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:50:36.766777 17202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.757060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38964 (local address 127.26.172.254:46223)
0806 11:50:36.757363 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.757366 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.757378 (+ 12us) server_negotiation.cc:407] Connection header received
0806 11:50:36.757426 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.757428 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.757473 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.757591 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:36.758519 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.759262 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.760298 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.760576 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.760698 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.762572 (+ 1874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:36.762576 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:36.762578 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:36.762608 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:36.764665 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.765200 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.765205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.765207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.765333 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.765657 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.765662 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.765664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.765917 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:36.766204 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.766334 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.766529 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":116,"threads_started":1}
I20260806 11:50:36.769863 16810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.753046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:39579 (local address 127.26.172.254:46223)
0806 11:50:36.753199 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.753204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.754595 (+ 1391us) server_negotiation.cc:407] Connection header received
0806 11:50:36.756902 (+ 2307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.756906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.756973 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.757123 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:36.758957 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.759597 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.761044 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.761310 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.761442 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.764838 (+ 3396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:36.764842 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:36.764845 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:36.764874 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:36.766663 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.767551 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.767559 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.767565 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.767678 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.768134 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.768138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.768140 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.768446 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:36.768559 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.769444 (+ 885us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.769663 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 11:50:36.770927 17199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.753610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:39579)
0806 11:50:36.754376 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:36.754439 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:36.756144 (+ 1705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:36.757441 (+ 1297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:36.757452 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:36.757976 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:50:36.758717 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.758735 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.759778 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.759782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.760888 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.760900 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.761510 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.761514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.761729 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.762452 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:50:36.762472 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:50:36.764593 (+ 2121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:50:36.766895 (+ 2302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:36.766905 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:36.766932 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:36.767388 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:36.767813 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:36.767815 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:36.767817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:36.767989 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:36.768587 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:50:36.768596 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:50:36.769004 (+ 408us) client_negotiation.cc:769] Sending connection context
0806 11:50:36.769262 (+ 258us) client_negotiation.cc:240] Negotiation successful
0806 11:50:36.769807 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":183,"threads_started":1}
I20260806 11:50:36.772493 17196 heartbeater.cc:347] Connected to a master server at 127.26.172.254:46223
I20260806 11:50:36.772817 17196 heartbeater.cc:464] Registering TS with master...
I20260806 11:50:36.773514 17196 heartbeater.cc:511] Master 127.26.172.254:46223 requested a full tablet report, sending...
I20260806 11:50:36.774927 16503 ts_manager.cc:194] Registered new tserver with Master: 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363)
I20260806 11:50:36.775676 16503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:39579
I20260806 11:50:36.782435 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:50:36.788107 16810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.783536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38974 (local address 127.26.172.254:46223)
0806 11:50:36.783771 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.783776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.783996 (+ 220us) server_negotiation.cc:407] Connection header received
0806 11:50:36.784299 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.784302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.784454 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.784595 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:50:36.784919 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.785511 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.786479 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.786716 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.786874 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.787307 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:50:36.787529 (+ 222us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 11:50:36.787911 (+ 382us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38974: token expired
Metrics: {"server-negotiator.queue_time_us":104}
W20260806 11:50:36.788206 16810 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38974: token expired
W20260806 11:50:36.788762 16396 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.172.254:46223)
I20260806 11:50:36.798503 16810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.789399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38978 (local address 127.26.172.254:46223)
0806 11:50:36.789550 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.789555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.789574 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:50:36.789712 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.789716 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.789784 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.789875 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:36.790716 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.791336 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.792305 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.792604 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.792712 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.794336 (+ 1624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:36.794339 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:36.794341 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:36.794371 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:36.796201 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.796802 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.796805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.796806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.796943 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:36.797398 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:36.797401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:36.797402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:36.797681 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:36.797815 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.798180 (+ 365us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.798342 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 11:50:36.802747 16503 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:50:36.807507 16503 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:50:36.819660 16702 tablet_service.cc:1467] Processing CreateTablet for tablet f4d8f943a220499da055998236076871 (DEFAULT_TABLE table=test-table [id=3ec589aed50c4b68865f26dc4a821a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:50:36.820634 16702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4d8f943a220499da055998236076871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:50:36.825380 17215 tablet_bootstrap.cc:492] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Bootstrap starting.
I20260806 11:50:36.826452 17209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.818330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:46363 (local address 127.0.0.1:57216)
0806 11:50:36.819133 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:36.819150 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:36.819299 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:36.820441 (+ 1142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:36.820445 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:36.820483 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:36.820766 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.820776 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.822346 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.822350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.824007 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.824025 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.825672 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.825676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.825890 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.826028 (+ 138us) client_negotiation.cc:769] Sending connection context
0806 11:50:36.826132 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 11:50:36.826246 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"mutex_wait_us":161,"spinlock_wait_cycles":9088,"thread_start_us":124,"threads_started":1}
I20260806 11:50:36.826562 17210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.818285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37730 (local address 127.26.172.194:37745)
0806 11:50:36.819576 (+ 1291us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.819591 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.819613 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:50:36.819687 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.819692 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.819974 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.820174 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:36.821102 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.822514 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.824205 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.825248 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.825415 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.825577 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.826237 (+ 660us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.826364 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1181,"thread_start_us":279,"threads_started":1}
I20260806 11:50:36.826879 17214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.818913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57216 (local address 127.26.172.195:46363)
0806 11:50:36.819506 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.819523 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.819554 (+ 31us) server_negotiation.cc:407] Connection header received
0806 11:50:36.819662 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.819669 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.819974 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.820175 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:36.820935 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.822152 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.824220 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.825248 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.825405 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.825577 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.826369 (+ 792us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.826576 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":234,"threads_started":1}
I20260806 11:50:36.827178 17208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.817994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37745 (local address 127.0.0.1:37730)
0806 11:50:36.818440 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:36.818461 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:36.818585 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:36.820441 (+ 1856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:36.820445 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:36.820486 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:36.820961 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.820969 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.822701 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.822705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.824033 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.824041 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.825672 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.825676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.825887 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.826028 (+ 141us) client_negotiation.cc:769] Sending connection context
0806 11:50:36.826123 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 11:50:36.826968 (+ 845us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":1010,"spinlock_wait_cycles":5760,"thread_start_us":115,"threads_started":1}
I20260806 11:50:36.831074 17215 tablet_bootstrap.cc:654] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Neither blocks nor log segments found. Creating new log.
I20260806 11:50:36.831005 17107 tablet_service.cc:1467] Processing CreateTablet for tablet f4d8f943a220499da055998236076871 (DEFAULT_TABLE table=test-table [id=3ec589aed50c4b68865f26dc4a821a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:50:36.831005 16910 tablet_service.cc:1467] Processing CreateTablet for tablet f4d8f943a220499da055998236076871 (DEFAULT_TABLE table=test-table [id=3ec589aed50c4b68865f26dc4a821a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:50:36.832453 17107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4d8f943a220499da055998236076871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:50:36.832448 16910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f4d8f943a220499da055998236076871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:50:36.833573 17215 tablet_bootstrap.cc:492] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: No bootstrap required, opened a new log
I20260806 11:50:36.833706 17215 ts_tablet_manager.cc:1397] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260806 11:50:36.834261 17215 raft_consensus.cc:348] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.834396 17215 raft_consensus.cc:374] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:50:36.834439 17215 raft_consensus.cc:729] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9a70f5efd0434286d987be5355339e, State: Initialized, Role: FOLLOWER
I20260806 11:50:36.834651 17215 consensus_queue.cc:260] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.835198 17215 ts_tablet_manager.cc:1428] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260806 11:50:36.842417 17222 tablet_bootstrap.cc:492] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: Bootstrap starting.
I20260806 11:50:36.843425 17223 tablet_bootstrap.cc:492] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: Bootstrap starting.
I20260806 11:50:36.846606 17222 tablet_bootstrap.cc:654] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: Neither blocks nor log segments found. Creating new log.
I20260806 11:50:36.847105 17223 tablet_bootstrap.cc:654] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: Neither blocks nor log segments found. Creating new log.
I20260806 11:50:36.847617 17222 log.cc:824] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: Log is configured to *not* fsync() on all Append() calls
I20260806 11:50:36.848354 17223 log.cc:824] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: Log is configured to *not* fsync() on all Append() calls
I20260806 11:50:36.850564 17222 tablet_bootstrap.cc:492] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: No bootstrap required, opened a new log
I20260806 11:50:36.851043 17222 ts_tablet_manager.cc:1397] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260806 11:50:36.851387 17223 tablet_bootstrap.cc:492] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: No bootstrap required, opened a new log
I20260806 11:50:36.851681 17223 ts_tablet_manager.cc:1397] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260806 11:50:36.854743 17222 raft_consensus.cc:348] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.855152 17222 raft_consensus.cc:374] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:50:36.855222 17222 raft_consensus.cc:729] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33dd6cb58ff24e48a626f9717135d490, State: Initialized, Role: FOLLOWER
I20260806 11:50:36.855717 17222 consensus_queue.cc:260] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.855648 17223 raft_consensus.cc:348] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.856149 17223 raft_consensus.cc:374] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:50:36.856233 17223 raft_consensus.cc:729] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 172385f623074781a5ac9b3075d36b01, State: Initialized, Role: FOLLOWER
I20260806 11:50:36.856686 17014 heartbeater.cc:503] Master 127.26.172.254:46223 was elected leader, sending a full tablet report...
I20260806 11:50:36.856961 17222 ts_tablet_manager.cc:1428] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260806 11:50:36.856940 17223 consensus_queue.cc:260] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.858033 17196 heartbeater.cc:503] Master 127.26.172.254:46223 was elected leader, sending a full tablet report...
I20260806 11:50:36.858402 17223 ts_tablet_manager.cc:1428] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260806 11:50:36.946317 17226 raft_consensus.cc:482] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:50:36.946631 17226 raft_consensus.cc:504] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.948220 17226 leader_election.cc:288] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363), ba9a70f5efd0434286d987be5355339e (127.26.172.193:42599)
I20260806 11:50:36.952888 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.948500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:46363 (local address 127.26.172.194:47541)
0806 11:50:36.948640 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:36.948659 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:36.948792 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:36.949289 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:36.949293 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:36.949310 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:36.949468 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.949474 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.950396 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.950402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.951474 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.951487 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.952422 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.952425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.952539 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.952569 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 11:50:36.952647 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 11:50:36.952730 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 11:50:36.952975 17214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.948705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:47541 (local address 127.26.172.195:46363)
0806 11:50:36.948888 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.948897 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.948918 (+ 21us) server_negotiation.cc:407] Connection header received
0806 11:50:36.949001 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.949004 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.949094 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.949247 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:36.949661 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.950253 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.951625 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.952239 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.952416 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.952481 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.952705 (+ 224us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.952807 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 11:50:36.953733 17228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.948703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42599 (local address 127.26.172.194:50151)
0806 11:50:36.949160 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:36.949178 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:36.949286 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:36.949830 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:36.949835 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:36.949861 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:36.950042 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.950050 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.951082 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.951088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.952148 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.952160 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.953337 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.953341 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.953444 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.953477 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 11:50:36.953550 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 11:50:36.953615 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":166,"threads_started":1}
I20260806 11:50:36.953853 17229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.948891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:50151 (local address 127.26.172.193:42599)
0806 11:50:36.949402 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.949427 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.949447 (+ 20us) server_negotiation.cc:407] Connection header received
0806 11:50:36.949518 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.949533 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.949615 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.949815 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:36.950185 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.950948 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.952371 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.953161 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.953330 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.953519 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.953592 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.953677 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":181,"threads_started":1}
I20260806 11:50:36.953756 17133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d8f943a220499da055998236076871" candidate_uuid: "33dd6cb58ff24e48a626f9717135d490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "172385f623074781a5ac9b3075d36b01" is_pre_election: true
I20260806 11:50:36.954161 17133 raft_consensus.cc:2454] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33dd6cb58ff24e48a626f9717135d490 in term 0.
I20260806 11:50:36.954584 17219 raft_consensus.cc:482] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:50:36.954598 16734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d8f943a220499da055998236076871" candidate_uuid: "33dd6cb58ff24e48a626f9717135d490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9a70f5efd0434286d987be5355339e" is_pre_election: true
I20260806 11:50:36.954859 17219 raft_consensus.cc:504] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.954910 16844 leader_election.cc:302] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 172385f623074781a5ac9b3075d36b01, 33dd6cb58ff24e48a626f9717135d490; no voters:
I20260806 11:50:36.955295 17226 raft_consensus.cc:2781] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:50:36.955441 17226 raft_consensus.cc:482] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:50:36.955497 17226 raft_consensus.cc:3037] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:50:36.955643 16734 raft_consensus.cc:2454] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33dd6cb58ff24e48a626f9717135d490 in term 0.
I20260806 11:50:36.956543 17219 leader_election.cc:288] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745), 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363)
I20260806 11:50:36.957451 17226 raft_consensus.cc:504] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.957985 17226 leader_election.cc:288] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [CANDIDATE]: Term 1 election: Requested vote from peers 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363), ba9a70f5efd0434286d987be5355339e (127.26.172.193:42599)
I20260806 11:50:36.958453 16734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d8f943a220499da055998236076871" candidate_uuid: "33dd6cb58ff24e48a626f9717135d490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba9a70f5efd0434286d987be5355339e"
I20260806 11:50:36.958662 16734 raft_consensus.cc:3037] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:50:36.960230 16734 raft_consensus.cc:2454] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33dd6cb58ff24e48a626f9717135d490 in term 1.
I20260806 11:50:36.960626 17133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d8f943a220499da055998236076871" candidate_uuid: "33dd6cb58ff24e48a626f9717135d490" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "172385f623074781a5ac9b3075d36b01"
I20260806 11:50:36.960718 16845 leader_election.cc:302] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33dd6cb58ff24e48a626f9717135d490, ba9a70f5efd0434286d987be5355339e; no voters:
I20260806 11:50:36.960813 17133 raft_consensus.cc:3037] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:50:36.961122 17226 raft_consensus.cc:2781] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:50:36.961470 17226 raft_consensus.cc:686] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 1 LEADER]: Becoming Leader. State: Replica: 33dd6cb58ff24e48a626f9717135d490, State: Running, Role: LEADER
I20260806 11:50:36.962001 17226 consensus_queue.cc:237] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:36.962564 17133 raft_consensus.cc:2454] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33dd6cb58ff24e48a626f9717135d490 in term 1.
I20260806 11:50:36.962602 17214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.956912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:42167 (local address 127.26.172.195:46363)
0806 11:50:36.957098 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.957104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.957372 (+ 268us) server_negotiation.cc:407] Connection header received
0806 11:50:36.957645 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.957650 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.957715 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.957815 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:36.958516 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.959328 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.961018 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.961722 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.961837 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.961906 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.962305 (+ 399us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.962420 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 11:50:36.962702 17210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.958462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:36853 (local address 127.26.172.194:37745)
0806 11:50:36.958631 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.958637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.958653 (+ 16us) server_negotiation.cc:407] Connection header received
0806 11:50:36.958703 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.958706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.958813 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.958931 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:50:36.959223 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.959964 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.961396 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.962015 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.962103 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.962153 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.962483 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.962564 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 11:50:36.963220 17231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.956766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37745 (local address 127.26.172.193:36853)
0806 11:50:36.957463 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:36.957482 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:36.957636 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:36.958950 (+ 1314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:36.958953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:36.958973 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:36.959101 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.959106 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.960109 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.960113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.961198 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.961208 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.962254 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.962259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.962350 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.962371 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 11:50:36.962944 (+ 573us) client_negotiation.cc:240] Negotiation successful
0806 11:50:36.963008 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"mutex_wait_us":340,"thread_start_us":138,"threads_started":1}
I20260806 11:50:36.963547 17230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.956766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:46363 (local address 127.26.172.193:42167)
0806 11:50:36.957235 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:36.957260 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:36.957481 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:36.957855 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:36.957859 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:36.957883 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:50:36.958365 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.958384 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.959470 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.959474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.960832 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:36.960843 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.962023 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.962027 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:36.962128 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.962154 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 11:50:36.962865 (+ 711us) client_negotiation.cc:240] Negotiation successful
0806 11:50:36.962983 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":187,"threads_started":1}
I20260806 11:50:36.964102 17133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d8f943a220499da055998236076871" candidate_uuid: "ba9a70f5efd0434286d987be5355339e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "172385f623074781a5ac9b3075d36b01" is_pre_election: true
I20260806 11:50:36.964191 16946 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4d8f943a220499da055998236076871" candidate_uuid: "ba9a70f5efd0434286d987be5355339e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33dd6cb58ff24e48a626f9717135d490" is_pre_election: true
I20260806 11:50:36.964372 17133 raft_consensus.cc:2379] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba9a70f5efd0434286d987be5355339e in current term 1: Already voted for candidate 33dd6cb58ff24e48a626f9717135d490 in this term.
I20260806 11:50:36.965230 16625 leader_election.cc:302] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba9a70f5efd0434286d987be5355339e; no voters: 172385f623074781a5ac9b3075d36b01, 33dd6cb58ff24e48a626f9717135d490
I20260806 11:50:36.965936 17219 raft_consensus.cc:2726] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 11:50:36.968071 16497 catalog_manager.cc:5495] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194). New cstate: current_term: 1 leader_uuid: "33dd6cb58ff24e48a626f9717135d490" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } health_report { overall_health: UNKNOWN } } }
I20260806 11:50:36.990460 17210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:36.985494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37736 (local address 127.26.172.194:37745)
0806 11:50:36.985773 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:36.985814 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:36.986024 (+ 210us) server_negotiation.cc:407] Connection header received
0806 11:50:36.986287 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:36.986291 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:36.986374 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:36.986518 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:50:36.986809 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.987554 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.988546 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:36.988804 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:36.988933 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:36.989352 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:50:36.989952 (+ 600us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:50:36.990125 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:36.990199 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 11:50:36.990265 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260806 11:50:36.999122 16734 raft_consensus.cc:1261] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Refusing update from remote peer 33dd6cb58ff24e48a626f9717135d490: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:50:36.999080 17133 raft_consensus.cc:1261] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [term 1 FOLLOWER]: Refusing update from remote peer 33dd6cb58ff24e48a626f9717135d490: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260806 11:50:36.999897 17015 tablet.cc:2369] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:50:37.000082 17226 consensus_queue.cc:1035] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:50:37.000362 17234 consensus_queue.cc:1035] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [LEADER]: Connected to new peer: Peer: permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 11:50:37.001868 17197 tablet.cc:2369] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:50:37.009281 16809 tablet.cc:2369] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:50:37.010787 17241 mvcc.cc:205] Tried to move back new op lower bound from 7315525783539040256 to 7315525783406292992. Current Snapshot: MvccSnapshot[applied={T|T < 7315525783539040256}]
I20260806 11:50:37.022701 16503 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:50:37.023005 16503 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:50:37.026453 16503 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Sending DeleteTablet for 3 replicas of tablet f4d8f943a220499da055998236076871
I20260806 11:50:37.027439 16910 tablet_service.cc:1514] Processing DeleteTablet for tablet f4d8f943a220499da055998236076871 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:50:37 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:37730
I20260806 11:50:37.027542 17107 tablet_service.cc:1514] Processing DeleteTablet for tablet f4d8f943a220499da055998236076871 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:50:37 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:57216
I20260806 11:50:37.028708 16702 tablet_service.cc:1514] Processing DeleteTablet for tablet f4d8f943a220499da055998236076871 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:50:37 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:51942
I20260806 11:50:37.028913 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 16559
I20260806 11:50:37.035651 17257 tablet_replica.cc:330] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: stopping tablet replica
I20260806 11:50:37.036368 17257 raft_consensus.cc:2229] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:50:37.036995 17257 raft_consensus.cc:2258] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:50:37.037669 17256 tablet_replica.cc:330] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: stopping tablet replica
I20260806 11:50:37.038100 17256 raft_consensus.cc:2229] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:50:37.038733 17256 raft_consensus.cc:2258] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:50:37.040696 17257 ts_tablet_manager.cc:1905] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:50:37.041136 17256 ts_tablet_manager.cc:1905] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:50:37.044360 17257 ts_tablet_manager.cc:1918] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:50:37.044632 17257 log.cc:1196] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/f4d8f943a220499da055998236076871
I20260806 11:50:37.045213 17257 ts_tablet_manager.cc:1939] T f4d8f943a220499da055998236076871 P 172385f623074781a5ac9b3075d36b01: Deleting consensus metadata
I20260806 11:50:37.045553 17256 ts_tablet_manager.cc:1918] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:50:37.045765 17256 log.cc:1196] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/f4d8f943a220499da055998236076871
I20260806 11:50:37.046259 17256 ts_tablet_manager.cc:1939] T f4d8f943a220499da055998236076871 P 33dd6cb58ff24e48a626f9717135d490: Deleting consensus metadata
I20260806 11:50:37.047433 16487 catalog_manager.cc:4841] TS 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363): tablet f4d8f943a220499da055998236076871 (table test-table [id=3ec589aed50c4b68865f26dc4a821a0d]) successfully deleted
I20260806 11:50:37.048000 16482 catalog_manager.cc:4841] TS 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745): tablet f4d8f943a220499da055998236076871 (table test-table [id=3ec589aed50c4b68865f26dc4a821a0d]) successfully deleted
W20260806 11:50:37.048501 16488 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:42599 (error 108)
I20260806 11:50:37.048974 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 16812
I20260806 11:50:37.053849 17208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:37.053397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:42599 (local address 127.0.0.1:51948)
0806 11:50:37.053662 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:37.053744 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:42599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175}
W20260806 11:50:37.054066 16488 catalog_manager.cc:4584] TS ba9a70f5efd0434286d987be5355339e (127.26.172.193:42599): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f4d8f943a220499da055998236076871: Network error: Client connection negotiation failed: client connection to 127.26.172.193:42599: connect: Connection refused (error 111)
I20260806 11:50:37.068645 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 17017
I20260806 11:50:37.093490 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 16450
I20260806 11:50:57.112509 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46223
--webserver_interface=127.26.172.254
--webserver_port=40769
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:46223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:50:57.271019 17267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:57.271631 17267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:57.271826 17267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:57.277084 17267 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 11:50:57.277432 17267 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 11:50:57.277514 17267 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 11:50:57.277554 17267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:50:57.277618 17267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:57.277664 17267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:57.277702 17267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:50:57.277742 17267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:50:57.284797 17267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:46223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=40769
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:57.286932 17267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:57.288523 17267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:50:57.301076 17275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:57.301137 17278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:57.301223 17267 server_base.cc:1034] running on GCE node
W20260806 11:50:57.301293 17274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:57.302603 17267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:57.304440 17267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:57.305712 17267 hybrid_clock.cc:648] HybridClock initialized: now 1786017057305664 us; error 67 us; skew 500 ppm
Aug 06 11:50:57 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017057, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:57.310441 17267 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:50:57.311900 17267 webserver.cc:460] Webserver started at http://127.26.172.254:40769/ using document root <none> and password file <none>
I20260806 11:50:57.312765 17267 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:57.312868 17267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:57.318694 17267 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 11:50:57.322284 17288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:57.324496 17267 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:50:57.324731 17267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "699a4c6870f6433eb68a5fcd62d121a9"
format_stamp: "Formatted at 2026-08-06 11:50:14 on dist-test-slave-7z32"
server_key: "b0d71af6c7b8420cce077350d8403faf"
server_key_iv: "3c30960d5f265acca9250fb3642bfad1"
server_key_version: "encryptionkey@0"
I20260806 11:50:57.325552 17267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:57.355320 17267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:57.359707 17267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:57.359921 17267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:57.369801 17267 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:46223
I20260806 11:50:57.370183 17359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:46223 every 8 connection(s)
I20260806 11:50:57.371714 17267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:50:57.375106 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 17267
I20260806 11:50:57.375741 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:42599
--local_ip_for_outbound_sockets=127.26.172.193
--tserver_master_addrs=127.26.172.254:46223
--webserver_port=33735
--webserver_interface=127.26.172.193
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:50:57.378309 17360 sys_catalog.cc:263] Verifying existing consensus state
I20260806 11:50:57.380486 17360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Bootstrap starting.
I20260806 11:50:57.402207 17360 log.cc:824] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Log is configured to *not* fsync() on all Append() calls
I20260806 11:50:57.415473 17360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:50:57.416000 17360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Bootstrap complete.
I20260806 11:50:57.420984 17360 raft_consensus.cc:348] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:57.421450 17360 raft_consensus.cc:729] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 699a4c6870f6433eb68a5fcd62d121a9, State: Initialized, Role: FOLLOWER
I20260806 11:50:57.422076 17360 consensus_queue.cc:260] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:57.422219 17360 raft_consensus.cc:388] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:50:57.422331 17360 raft_consensus.cc:482] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:50:57.422473 17360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 2 FOLLOWER]: Advancing to term 3
I20260806 11:50:57.424868 17360 raft_consensus.cc:504] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:57.425292 17360 leader_election.cc:302] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 699a4c6870f6433eb68a5fcd62d121a9; no voters:
I20260806 11:50:57.425711 17360 leader_election.cc:288] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 11:50:57.425820 17369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 11:50:57.426079 17369 raft_consensus.cc:686] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [term 3 LEADER]: Becoming Leader. State: Replica: 699a4c6870f6433eb68a5fcd62d121a9, State: Running, Role: LEADER
I20260806 11:50:57.426440 17369 consensus_queue.cc:237] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } }
I20260806 11:50:57.427341 17360 sys_catalog.cc:564] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:50:57.427611 17371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 699a4c6870f6433eb68a5fcd62d121a9. Latest consensus state: current_term: 3 leader_uuid: "699a4c6870f6433eb68a5fcd62d121a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } } }
I20260806 11:50:57.427745 17371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: This master's current role is: LEADER
I20260806 11:50:57.428565 17370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "699a4c6870f6433eb68a5fcd62d121a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699a4c6870f6433eb68a5fcd62d121a9" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46223 } } }
I20260806 11:50:57.428711 17370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9 [sys.catalog]: This master's current role is: LEADER
I20260806 11:50:57.429807 17376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:50:57.437523 17376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:50:57.438388 17376 catalog_manager.cc:1259] Loaded cluster ID: 9576fb8ff1214986acb4522ea60470b3
I20260806 11:50:57.438464 17376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:50:57.441412 17376 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:50:57.442441 17376 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Loaded TSK: 0
I20260806 11:50:57.442559 17376 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 699a4c6870f6433eb68a5fcd62d121a9: Loaded TSK: 1
F20260806 11:50:57.443537 17376 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbf2072f9ad google::LogMessage::Fail() at ??:0
@ 0x7fbf2073288a google::LogMessage::SendToLog() at ??:0
@ 0x7fbf2072f4de google::LogMessage::Flush() at ??:0
@ 0x7fbf20730a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbf233f318d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fbf233ebf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fbf2b0947bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fbf2b06e99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fbf2b06f178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7fbf2b0b0df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fbf2b0cf82b std::function<>::operator()() at ??:0
@ 0x7fbf2b06eb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fbf2b06ff3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbf2b06c579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fbf2b0b0640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fbf229813d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbf22981c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fbf229833f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fbf22972512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbf23fb66db start_thread at ??:0
@ 0x7fbf1f22d61f clone at ??:0
W20260806 11:50:57.575373 17366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:57.575767 17366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:57.575860 17366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:57.580572 17366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:57.580673 17366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:57.580749 17366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:50:57.587615 17366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:42599
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=33735
--tserver_master_addrs=127.26.172.254:46223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:57.589244 17366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:57.590631 17366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:50:57.605430 17433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:57.605536 17432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:57.605405 17436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:57.606352 17366 server_base.cc:1034] running on GCE node
I20260806 11:50:57.607141 17366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:57.608179 17366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:57.609458 17366 hybrid_clock.cc:648] HybridClock initialized: now 1786017057609432 us; error 56 us; skew 500 ppm
Aug 06 11:50:57 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017057, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:57.613844 17366 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:50:57.615494 17366 webserver.cc:460] Webserver started at http://127.26.172.193:33735/ using document root <none> and password file <none>
I20260806 11:50:57.616389 17366 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:57.616535 17366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:57.622946 17366 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 11:50:57.626484 17446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:57.628806 17366 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:50:57.629055 17366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "ba9a70f5efd0434286d987be5355339e"
format_stamp: "Formatted at 2026-08-06 11:50:14 on dist-test-slave-7z32"
server_key: "470c9d4654c9b425e8896c9aaf8510bd"
server_key_iv: "7f171247e066ce6a230da20ca60728fa"
server_key_version: "encryptionkey@0"
I20260806 11:50:57.629909 17366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:57.662560 17366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:57.667255 17366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:57.667515 17366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:57.668373 17366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:50:57.669910 17457 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 11:50:57.676685 17366 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 11:50:57.676838 17366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260806 11:50:57.676950 17366 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 11:50:57.680699 17366 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 11:50:57.680816 17366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.002s sys 0.000s
I20260806 11:50:57.681298 17457 tablet_bootstrap.cc:492] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Bootstrap starting.
I20260806 11:50:57.696273 17366 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:42599
I20260806 11:50:57.696326 17614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:42599 every 8 connection(s)
I20260806 11:50:57.697645 17366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:50:57.698611 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 17366
I20260806 11:50:57.699286 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:37745
--local_ip_for_outbound_sockets=127.26.172.194
--tserver_master_addrs=127.26.172.254:46223
--webserver_port=37517
--webserver_interface=127.26.172.194
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:50:57.702502 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:57.700358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:36595)
0806 11:50:57.701110 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:57.701276 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":288,"threads_started":1}
W20260806 11:50:57.703258 17615 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:46223 (0 consecutive failures): Network error: Failed to ping master at 127.26.172.254:46223: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
I20260806 11:50:57.704320 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:57.703920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:42189)
0806 11:50:57.704116 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:57.704200 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 11:50:57.705273 17457 log.cc:824] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Log is configured to *not* fsync() on all Append() calls
I20260806 11:50:57.705410 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:57.705060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:52349)
0806 11:50:57.705216 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:57.705284 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 11:50:57.705633 17615 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 11:50:57.716910 17457 tablet_bootstrap.cc:492] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 11:50:57.717471 17457 tablet_bootstrap.cc:492] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Bootstrap complete.
I20260806 11:50:57.719485 17457 ts_tablet_manager.cc:1397] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Time spent bootstrapping tablet: real 0.039s user 0.026s sys 0.011s
I20260806 11:50:57.723459 17457 raft_consensus.cc:348] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:57.724113 17457 raft_consensus.cc:729] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba9a70f5efd0434286d987be5355339e, State: Initialized, Role: FOLLOWER
I20260806 11:50:57.724705 17457 consensus_queue.cc:260] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:57.726068 17457 ts_tablet_manager.cc:1428] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260806 11:50:57.726637 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:57.726266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:43117)
0806 11:50:57.726429 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:57.726509 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 11:50:57.727730 17617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:57.727427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:47003)
0806 11:50:57.727602 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:57.727663 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260806 11:50:57.846028 17618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:57.846431 17618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:57.846525 17618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:57.851464 17618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:57.851555 17618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:57.851677 17618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:50:57.858084 17618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:37745
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=37517
--tserver_master_addrs=127.26.172.254:46223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:57.859552 17618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:57.860792 17618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:50:57.872967 17630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:57.873028 17634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:57.873013 17631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:57.873821 17618 server_base.cc:1034] running on GCE node
I20260806 11:50:57.874368 17618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:57.875206 17618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:57.876412 17618 hybrid_clock.cc:648] HybridClock initialized: now 1786017057876379 us; error 53 us; skew 500 ppm
Aug 06 11:50:57 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017057, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:57.879823 17618 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:50:57.881035 17618 webserver.cc:460] Webserver started at http://127.26.172.194:37517/ using document root <none> and password file <none>
I20260806 11:50:57.881717 17618 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:57.881790 17618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:57.886562 17618 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260806 11:50:57.889441 17647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:57.891191 17618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 11:50:57.891348 17618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "33dd6cb58ff24e48a626f9717135d490"
format_stamp: "Formatted at 2026-08-06 11:50:15 on dist-test-slave-7z32"
server_key: "af46cbd8f1fa727af6f88d67c4508968"
server_key_iv: "e7bc68867626c86ab5a1f7d761fc5c8b"
server_key_version: "encryptionkey@0"
I20260806 11:50:57.892006 17618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:57.910609 17618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:57.914371 17618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:57.914613 17618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:57.915381 17618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:50:57.916385 17618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:50:57.916463 17618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:57.916530 17618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:50:57.916579 17618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:57.928532 17618 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:37745
I20260806 11:50:57.928643 17812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:37745 every 8 connection(s)
I20260806 11:50:57.929809 17618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:50:57.933959 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 17618
I20260806 11:50:57.934731 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:46363
--local_ip_for_outbound_sockets=127.26.172.195
--tserver_master_addrs=127.26.172.254:46223
--webserver_port=46817
--webserver_interface=127.26.172.195
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:50:57.936187 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:57.932802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:45115)
0806 11:50:57.933541 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:57.933769 (+ 228us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":144,"threads_started":1}
W20260806 11:50:57.936836 17813 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:46223 (0 consecutive failures): Network error: Failed to ping master at 127.26.172.254:46223: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
I20260806 11:50:57.937819 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:57.937462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:44111)
0806 11:50:57.937671 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:57.937744 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260806 11:50:57.938793 17815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:57.938408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:41277)
0806 11:50:57.938629 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:57.938715 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 11:50:57.939109 17813 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 11:50:58.060117 17817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:50:58.060516 17817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:50:58.060568 17817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:50:58.064899 17817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:50:58.064987 17817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:50:58.065056 17817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:50:58.070704 17817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:46363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=46817
--tserver_master_addrs=127.26.172.254:46223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:50:58.071970 17817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:50:58.073071 17817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:50:58.084949 17831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:58.084985 17835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:50:58.084985 17830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:50:58.085335 17817 server_base.cc:1034] running on GCE node
I20260806 11:50:58.086148 17817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:50:58.086994 17817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:50:58.088294 17817 hybrid_clock.cc:648] HybridClock initialized: now 1786017058088264 us; error 49 us; skew 500 ppm
Aug 06 11:50:58 dist-test-slave-7z32 krb5kdc[15637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017058, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:50:58.091532 17817 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:50:58.092617 17817 webserver.cc:460] Webserver started at http://127.26.172.195:46817/ using document root <none> and password file <none>
I20260806 11:50:58.093222 17817 fs_manager.cc:359] Metadata directory not provided
I20260806 11:50:58.093294 17817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:50:58.097894 17817 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260806 11:50:58.100586 17845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:58.102506 17817 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 11:50:58.102659 17817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "172385f623074781a5ac9b3075d36b01"
format_stamp: "Formatted at 2026-08-06 11:50:15 on dist-test-slave-7z32"
server_key: "bc8dfb55b41283bdcc8796185278c1b1"
server_key_iv: "8cdc0617619b65fe953a92588602c8fe"
server_key_version: "encryptionkey@0"
I20260806 11:50:58.103374 17817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:50:58.123000 17817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:50:58.127045 17817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:50:58.127259 17817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:50:58.127921 17817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:50:58.128948 17817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:50:58.129014 17817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:58.129060 17817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:50:58.129103 17817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:50:58.140686 17817 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:46363
I20260806 11:50:58.140795 18010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:46363 every 8 connection(s)
I20260806 11:50:58.141918 17817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:50:58.146308 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 17817
I20260806 11:50:58.147782 18015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:58.144987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:48397)
0806 11:50:58.145742 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:58.146341 (+ 599us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":162,"threads_started":1}
W20260806 11:50:58.148620 18011 heartbeater.cc:644] Failed to heartbeat to 127.26.172.254:46223 (0 consecutive failures): Network error: Failed to ping master at 127.26.172.254:46223: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
I20260806 11:50:58.149515 18015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:58.149209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:44709)
0806 11:50:58.149357 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:58.149434 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 11:50:58.150539 18015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:58.150236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:56817)
0806 11:50:58.150412 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:58.150474 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260806 11:50:58.151007 18011 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 11:50:58.729717 18018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:58.729052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:47327)
0806 11:50:58.729492 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:58.729598 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":121,"threads_started":1}
I20260806 11:50:58.940663 18023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:58.939983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:60991)
0806 11:50:58.940423 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:58.940509 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":154,"threads_started":1}
I20260806 11:50:59.152709 18024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:59.151878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:34339)
0806 11:50:59.152377 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:59.152495 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":98,"threads_started":1}
I20260806 11:50:59.576987 18026 raft_consensus.cc:482] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:50:59.577219 18026 raft_consensus.cc:504] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:50:59.578588 18026 leader_election.cc:288] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745), 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363)
Aug 06 11:50:59 dist-test-slave-7z32 krb5kdc[15637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017057, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.194@KRBTEST.COM
Aug 06 11:50:59 dist-test-slave-7z32 krb5kdc[15637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017057, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.195@KRBTEST.COM
I20260806 11:50:59.603194 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:59.579238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:43019 (local address 127.26.172.194:37745)
0806 11:50:59.579929 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:59.579958 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:59.580066 (+ 108us) server_negotiation.cc:407] Connection header received
0806 11:50:59.581035 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:59.581042 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:59.581458 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:59.581799 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:59.583298 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:59.584600 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:59.585766 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:59.586540 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:59.586727 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:59.596218 (+ 9491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:59.596230 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:59.596253 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:59.596312 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:59.599440 (+ 3128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:59.600430 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:59.600437 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:59.600443 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:59.600591 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:59.601009 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:59.601012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:59.601014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:59.601664 (+ 650us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:59.601822 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:59.602576 (+ 754us) server_negotiation.cc:299] Negotiation successful
0806 11:50:59.602949 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":102,"threads_started":1}
I20260806 11:50:59.603259 18034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:59.579201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:53539 (local address 127.26.172.195:46363)
0806 11:50:59.579792 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0806 11:50:59.579819 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0806 11:50:59.579868 (+ 49us) server_negotiation.cc:407] Connection header received
0806 11:50:59.580981 (+ 1113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:50:59.580987 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:50:59.581307 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:50:59.581621 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:50:59.583287 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:59.584397 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:59.585714 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:50:59.586197 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:50:59.586424 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:59.596455 (+ 10031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:50:59.596463 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:50:59.596483 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:50:59.596522 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:50:59.599688 (+ 3166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:59.600388 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:59.600395 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:59.600406 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:59.600564 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:50:59.601020 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:50:59.601024 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:50:59.601026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:50:59.601662 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:50:59.601857 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 11:50:59.602617 (+ 760us) server_negotiation.cc:299] Negotiation successful
0806 11:50:59.602996 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":181,"threads_started":1}
I20260806 11:50:59.603245 18032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:59.579043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:37745 (local address 127.26.172.193:43019)
0806 11:50:59.579570 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:59.579589 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:59.580000 (+ 411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:59.581750 (+ 1750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:59.581754 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:59.582459 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:50:59.583088 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:59.583106 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:59.584808 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:59.584817 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:59.585586 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:59.585597 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:59.586958 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:59.586965 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:59.587100 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:59.593179 (+ 6079us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:50:59.593205 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:50:59.595727 (+ 2522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:50:59.599656 (+ 3929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:59.599667 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:59.599688 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:59.600208 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:59.600744 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:59.600747 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:59.600748 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:59.600887 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:59.601812 (+ 925us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:50:59.601821 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:50:59.602211 (+ 390us) client_negotiation.cc:769] Sending connection context
0806 11:50:59.602426 (+ 215us) client_negotiation.cc:240] Negotiation successful
0806 11:50:59.602994 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":179,"spinlock_wait_cycles":49536,"thread_start_us":97,"threads_started":1}
I20260806 11:50:59.603431 18029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:59.578957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:46363 (local address 127.26.172.193:53539)
0806 11:50:59.579360 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:59.579410 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 11:50:59.579980 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:50:59.581675 (+ 1695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:50:59.581684 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:50:59.582465 (+ 781us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:50:59.583086 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:59.583106 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:59.584567 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:59.584570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:59.585582 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:50:59.585592 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:50:59.586379 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:50:59.586383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:50:59.586614 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:50:59.593220 (+ 6606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:50:59.593240 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:50:59.596010 (+ 2770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:50:59.599870 (+ 3860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:59.599872 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:59.599875 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:59.600212 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:59.600685 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:50:59.600691 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:50:59.600696 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:50:59.600886 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:50:59.601831 (+ 945us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:50:59.601834 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:50:59.602161 (+ 327us) client_negotiation.cc:769] Sending connection context
0806 11:50:59.602428 (+ 267us) client_negotiation.cc:240] Negotiation successful
0806 11:50:59.603114 (+ 686us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":241,"spinlock_wait_cycles":1408,"thread_start_us":108,"threads_started":1}
W20260806 11:50:59.607120 17450 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363): Not found: Tablet not found: f4d8f943a220499da055998236076871
W20260806 11:50:59.607340 17447 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745): Not found: Tablet not found: f4d8f943a220499da055998236076871
I20260806 11:50:59.607506 17447 leader_election.cc:302] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba9a70f5efd0434286d987be5355339e; no voters: 172385f623074781a5ac9b3075d36b01, 33dd6cb58ff24e48a626f9717135d490
I20260806 11:50:59.607923 18026 raft_consensus.cc:2726] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:50:59.731663 18032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:59.731192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:58999)
0806 11:50:59.731402 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:59.731518 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260806 11:50:59.942461 18035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:50:59.941950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:37717)
0806 11:50:59.942256 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0806 11:50:59.942328 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":110,"threads_started":1}
I20260806 11:51:00.154510 18036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:00.153841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:47447)
0806 11:51:00.154251 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:00.154363 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":97,"threads_started":1}
I20260806 11:51:00.733777 18037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:00.732983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:41491)
0806 11:51:00.733550 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:00.733640 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":124,"threads_started":1}
I20260806 11:51:00.944387 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:00.943708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:44285)
0806 11:51:00.944168 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:00.944258 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":139,"threads_started":1}
I20260806 11:51:01.156350 18039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:01.155615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:36539)
0806 11:51:01.156075 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:01.156175 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":112,"threads_started":1}
I20260806 11:51:01.567387 18040 raft_consensus.cc:482] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:01.567600 18040 raft_consensus.cc:504] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:51:01.568149 18040 leader_election.cc:288] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745), 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363)
W20260806 11:51:01.569662 17450 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363): Not found: Tablet not found: f4d8f943a220499da055998236076871
W20260806 11:51:01.569871 17447 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745): Not found: Tablet not found: f4d8f943a220499da055998236076871
I20260806 11:51:01.569936 17450 leader_election.cc:302] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba9a70f5efd0434286d987be5355339e; no voters: 172385f623074781a5ac9b3075d36b01, 33dd6cb58ff24e48a626f9717135d490
I20260806 11:51:01.570204 18040 raft_consensus.cc:2726] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:51:01.735792 18041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:01.735013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:40327)
0806 11:51:01.735426 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:01.735509 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":107,"threads_started":1}
I20260806 11:51:01.946208 18042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:01.945547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:57581)
0806 11:51:01.945965 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:01.946059 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":110,"threads_started":1}
I20260806 11:51:02.158371 18045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:02.157662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:48403)
0806 11:51:02.158077 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:02.158161 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":154,"threads_started":1}
I20260806 11:51:02.737419 18046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:02.736810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:44433)
0806 11:51:02.737200 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:02.737283 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":108,"threads_started":1}
I20260806 11:51:02.948263 18049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:02.947623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:53851)
0806 11:51:02.948052 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:02.948131 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":131,"threads_started":1}
I20260806 11:51:03.160328 18050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:03.159720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:54089)
0806 11:51:03.160121 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:03.160210 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":113,"threads_started":1}
I20260806 11:51:03.252444 18051 raft_consensus.cc:482] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:03.252655 18051 raft_consensus.cc:504] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:51:03.253311 18051 leader_election.cc:288] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745), 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363)
W20260806 11:51:03.254467 17450 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363): Not found: Tablet not found: f4d8f943a220499da055998236076871
W20260806 11:51:03.254647 17447 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745): Not found: Tablet not found: f4d8f943a220499da055998236076871
I20260806 11:51:03.254729 17447 leader_election.cc:302] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba9a70f5efd0434286d987be5355339e; no voters: 172385f623074781a5ac9b3075d36b01, 33dd6cb58ff24e48a626f9717135d490
I20260806 11:51:03.254971 18051 raft_consensus.cc:2726] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:51:03.739140 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:03.738357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:40389)
0806 11:51:03.738729 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:03.738999 (+ 270us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":103,"threads_started":1}
I20260806 11:51:03.950260 18054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:03.949560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:42875)
0806 11:51:03.949997 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:03.950090 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":105,"threads_started":1}
I20260806 11:51:04.162052 18055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:04.161519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:40681)
0806 11:51:04.161837 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:04.161917 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":90,"threads_started":1}
I20260806 11:51:04.740712 18057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:04.740033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:54331)
0806 11:51:04.740445 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:04.740553 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":91,"threads_started":1}
I20260806 11:51:04.952246 18058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:04.951576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:56093)
0806 11:51:04.952039 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:04.952124 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":114,"threads_started":1}
I20260806 11:51:05.164175 18059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:05.163440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:33227)
0806 11:51:05.163972 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:05.164060 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":153,"threads_started":1}
I20260806 11:51:05.329440 18063 raft_consensus.cc:482] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:05.329674 18063 raft_consensus.cc:504] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:51:05.330278 18063 leader_election.cc:288] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745), 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363)
W20260806 11:51:05.331615 17450 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363): Not found: Tablet not found: f4d8f943a220499da055998236076871
W20260806 11:51:05.331853 17447 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745): Not found: Tablet not found: f4d8f943a220499da055998236076871
I20260806 11:51:05.332015 17447 leader_election.cc:302] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba9a70f5efd0434286d987be5355339e; no voters: 172385f623074781a5ac9b3075d36b01, 33dd6cb58ff24e48a626f9717135d490
I20260806 11:51:05.332304 18063 raft_consensus.cc:2726] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:51:05.742560 18064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:05.741933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:46817)
0806 11:51:05.742358 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:05.742443 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":167,"threads_started":1}
I20260806 11:51:05.953873 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:05.953226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:58313)
0806 11:51:05.953643 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:05.953732 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":97,"threads_started":1}
I20260806 11:51:06.165911 18067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:06.165338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:59427)
0806 11:51:06.165725 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:06.165805 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":128,"threads_started":1}
I20260806 11:51:06.744525 18068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:06.743879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:54553)
0806 11:51:06.744289 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:06.744385 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":121,"threads_started":1}
I20260806 11:51:06.956066 18069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:06.955390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:35325)
0806 11:51:06.955830 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:06.955911 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":142,"threads_started":1}
I20260806 11:51:07.167709 18071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:07.167102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:49501)
0806 11:51:07.167492 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:07.167577 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":114,"threads_started":1}
I20260806 11:51:07.746547 18072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:07.745892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:36711)
0806 11:51:07.746288 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:07.746388 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":97,"threads_started":1}
I20260806 11:51:07.957715 18073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:07.957183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:44677)
0806 11:51:07.957530 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:07.957601 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":110,"threads_started":1}
I20260806 11:51:08.169636 18075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:08.168907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:54005)
0806 11:51:08.169387 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:08.169489 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":103,"threads_started":1}
I20260806 11:51:08.748323 18076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:08.747651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:48341)
0806 11:51:08.748084 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:08.748180 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":91,"threads_started":1}
I20260806 11:51:08.825400 18077 raft_consensus.cc:482] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:08.825608 18077 raft_consensus.cc:504] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:51:08.826292 18077 leader_election.cc:288] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745), 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363)
W20260806 11:51:08.827518 17450 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363): Not found: Tablet not found: f4d8f943a220499da055998236076871
W20260806 11:51:08.827682 17447 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745): Not found: Tablet not found: f4d8f943a220499da055998236076871
I20260806 11:51:08.827841 17447 leader_election.cc:302] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba9a70f5efd0434286d987be5355339e; no voters: 172385f623074781a5ac9b3075d36b01, 33dd6cb58ff24e48a626f9717135d490
I20260806 11:51:08.828094 18077 raft_consensus.cc:2726] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:51:08.959419 18078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:08.958766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:47739)
0806 11:51:08.959220 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:08.959292 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":177,"threads_started":1}
I20260806 11:51:09.171638 18079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:09.170967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:54781)
0806 11:51:09.171385 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:09.171488 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":118,"threads_started":1}
I20260806 11:51:09.750192 18080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:09.749569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:36733)
0806 11:51:09.749931 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:09.750023 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":92,"threads_started":1}
I20260806 11:51:09.961196 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:09.960598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:55661)
0806 11:51:09.960978 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:09.961057 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":113,"threads_started":1}
I20260806 11:51:10.173731 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:10.173062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:56511)
0806 11:51:10.173507 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:10.173608 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":122,"threads_started":1}
I20260806 11:51:10.333106 18087 raft_consensus.cc:482] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:10.333290 18087 raft_consensus.cc:504] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33dd6cb58ff24e48a626f9717135d490" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 37745 } } peers { permanent_uuid: "172385f623074781a5ac9b3075d36b01" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46363 } } peers { permanent_uuid: "ba9a70f5efd0434286d987be5355339e" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 42599 } }
I20260806 11:51:10.333845 18087 leader_election.cc:288] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745), 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363)
W20260806 11:51:10.335129 17450 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 172385f623074781a5ac9b3075d36b01 (127.26.172.195:46363): Not found: Tablet not found: f4d8f943a220499da055998236076871
W20260806 11:51:10.335328 17447 leader_election.cc:341] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 33dd6cb58ff24e48a626f9717135d490 (127.26.172.194:37745): Not found: Tablet not found: f4d8f943a220499da055998236076871
I20260806 11:51:10.335407 17447 leader_election.cc:302] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba9a70f5efd0434286d987be5355339e; no voters: 172385f623074781a5ac9b3075d36b01, 33dd6cb58ff24e48a626f9717135d490
I20260806 11:51:10.335578 18087 raft_consensus.cc:2726] T f4d8f943a220499da055998236076871 P ba9a70f5efd0434286d987be5355339e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 11:51:10.752238 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:10.751545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:52465)
0806 11:51:10.751896 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:10.752116 (+ 220us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":146,"threads_started":1}
I20260806 11:51:10.962982 18090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:10.962332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:48755)
0806 11:51:10.962701 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:10.962785 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":106,"threads_started":1}
I20260806 11:51:11.175736 18092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:11.175041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:57907)
0806 11:51:11.175494 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:11.175607 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":130,"threads_started":1}
I20260806 11:51:11.754025 18093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:11.753363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:53815)
0806 11:51:11.753793 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:11.753888 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":117,"threads_started":1}
I20260806 11:51:11.965057 18094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:11.964354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:52261)
0806 11:51:11.964815 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:11.964913 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":114,"threads_started":1}
I20260806 11:51:12.177731 18095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:12.176969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:60547)
0806 11:51:12.177470 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:12.177584 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":116,"threads_started":1}
I20260806 11:51:12.756520 18096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:12.755856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.193:43781)
0806 11:51:12.756288 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:12.756382 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":101,"threads_started":1}
I20260806 11:51:12.966989 18097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:12.966302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.194:58311)
0806 11:51:12.966679 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:12.966760 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":91,"threads_started":1}
I20260806 11:51:13.148407 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 17366
I20260806 11:51:13.169221 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 17618
I20260806 11:51:13.180135 18098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:13.179505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:46223 (local address 127.26.172.195:45611)
0806 11:51:13.179929 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:13.180011 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.254:46223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":129,"threads_started":1}
I20260806 11:51:13.183195 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 17817
2026-08-06T11:51:13Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (60351 ms)
[----------] 30 tests from SecurityITest (286638 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:13 dist-test-slave-7z32 krb5kdc[18105](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:13 dist-test-slave-7z32 krb5kdc[18105](info): set up 2 sockets
Aug 06 11:51:13 dist-test-slave-7z32 krb5kdc[18105](info): commencing operation
krb5kdc: starting...
W20260806 11:51:14.491806 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.001s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:14 dist-test-slave-7z32 krb5kdc[18105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:51:14.660643 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:33493
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:33493
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:14.793428 18127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:14.793757 18127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:14.793802 18127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:14.798120 18127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:14.798216 18127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:14.798237 18127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:14.798273 18127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:14.798290 18127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:14.804234 18127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:33493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:33493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:14.805548 18127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:14.806670 18127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:14.819860 18134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:14.819867 18135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:14.819854 18139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:14.820294 18127 server_base.cc:1034] running on GCE node
I20260806 11:51:14.821329 18127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:14.823055 18127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:14.824415 18127 hybrid_clock.cc:648] HybridClock initialized: now 1786017074824379 us; error 69 us; skew 500 ppm
Aug 06 11:51:14 dist-test-slave-7z32 krb5kdc[18105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017074, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:14.828749 18127 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:51:14.830367 18127 webserver.cc:460] Webserver started at http://127.26.172.254:44199/ using document root <none> and password file <none>
I20260806 11:51:14.831310 18127 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:14.831423 18127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:14.831700 18127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:14.835011 18127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "c6e81318c42847c48076484b9849f239"
format_stamp: "Formatted at 2026-08-06 11:51:14 on dist-test-slave-7z32"
server_key: "7d45122536690af896f34228f65a7006"
server_key_iv: "54e2013eeb62c8bd5306e84fceca838f"
server_key_version: "encryptionkey@0"
I20260806 11:51:14.835896 18127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "c6e81318c42847c48076484b9849f239"
format_stamp: "Formatted at 2026-08-06 11:51:14 on dist-test-slave-7z32"
server_key: "7d45122536690af896f34228f65a7006"
server_key_iv: "54e2013eeb62c8bd5306e84fceca838f"
server_key_version: "encryptionkey@0"
I20260806 11:51:14.843549 18127 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260806 11:51:14.848448 18147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:14.850577 18127 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:14.850891 18127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "c6e81318c42847c48076484b9849f239"
format_stamp: "Formatted at 2026-08-06 11:51:14 on dist-test-slave-7z32"
server_key: "7d45122536690af896f34228f65a7006"
server_key_iv: "54e2013eeb62c8bd5306e84fceca838f"
server_key_version: "encryptionkey@0"
I20260806 11:51:14.851101 18127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:14.875619 18127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:14.880375 18127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:14.880692 18127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:14.893005 18127 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:33493
I20260806 11:51:14.893091 18224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:33493 every 8 connection(s)
I20260806 11:51:14.894917 18127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:14.899693 18226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:14.902907 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 18127
I20260806 11:51:14.903172 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:14.903566 27315 external_mini_cluster.cc:1428] Setting key 576f380f1c4320d2bcd96802dc705a2c
I20260806 11:51:14.908357 18226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239: Bootstrap starting.
I20260806 11:51:14.911494 18226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:14.912388 18226 log.cc:824] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:14.914953 18226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239: No bootstrap required, opened a new log
Aug 06 11:51:14 dist-test-slave-7z32 krb5kdc[18105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:14.919697 18226 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e81318c42847c48076484b9849f239" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33493 } }
I20260806 11:51:14.920013 18226 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:14.920109 18226 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e81318c42847c48076484b9849f239, State: Initialized, Role: FOLLOWER
I20260806 11:51:14.920722 18226 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e81318c42847c48076484b9849f239" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33493 } }
I20260806 11:51:14.920929 18226 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:14.921056 18226 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:14.921218 18226 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:14.922740 18226 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e81318c42847c48076484b9849f239" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33493 } }
I20260806 11:51:14.923261 18226 leader_election.cc:302] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6e81318c42847c48076484b9849f239; no voters:
I20260806 11:51:14.923782 18226 leader_election.cc:288] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:14.923877 18235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:14.924196 18235 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [term 1 LEADER]: Becoming Leader. State: Replica: c6e81318c42847c48076484b9849f239, State: Running, Role: LEADER
I20260806 11:51:14.924638 18235 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e81318c42847c48076484b9849f239" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33493 } }
I20260806 11:51:14.926875 18236 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6e81318c42847c48076484b9849f239. Latest consensus state: current_term: 1 leader_uuid: "c6e81318c42847c48076484b9849f239" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e81318c42847c48076484b9849f239" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33493 } } }
I20260806 11:51:14.927114 18236 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:14.927521 18237 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6e81318c42847c48076484b9849f239" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6e81318c42847c48076484b9849f239" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33493 } } }
I20260806 11:51:14.927654 18237 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:14.927811 18226 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:14.928437 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:14.905605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46986 (local address 127.26.172.254:33493)
0806 11:51:14.906339 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:14.906374 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:14.906447 (+ 73us) server_negotiation.cc:407] Connection header received
0806 11:51:14.907906 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:14.907950 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:14.908670 (+ 720us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:14.909223 (+ 553us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:14.910386 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:14.912372 (+ 1986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:14.914025 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:14.914780 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:14.915195 (+ 415us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:14.919405 (+ 4210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:14.919418 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:14.919457 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:14.919525 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:14.922585 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:14.923471 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:14.923482 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:14.923492 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:14.923756 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:14.924138 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:14.924143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:14.924146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:14.924937 (+ 791us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:14.925185 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:14.926454 (+ 1269us) server_negotiation.cc:299] Negotiation successful
0806 11:51:14.926971 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":226,"threads_started":1}
I20260806 11:51:14.929245 18239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:14.933228 18239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:14.939669 18239 catalog_manager.cc:1347] Generated new cluster ID: 26dff914a4d644af947c4d91e0effdc5
I20260806 11:51:14.939765 18239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:14.963627 18239 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:14.964710 18239 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:14.977435 18239 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239: Generated new TSK 0
I20260806 11:51:14.978524 18239 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:51:15.027513 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33493
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:15.200032 18266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:15.200430 18266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:15.200484 18266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:15.205003 18266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:15.205101 18266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:15.205173 18266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:51:15.211730 18266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:15.213485 18266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:15.215010 18266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:15.228621 18279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:15.228626 18277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:15.228621 18274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:15.229305 18266 server_base.cc:1034] running on GCE node
I20260806 11:51:15.230008 18266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:15.231029 18266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:15.232249 18266 hybrid_clock.cc:648] HybridClock initialized: now 1786017075232228 us; error 38 us; skew 500 ppm
Aug 06 11:51:15 dist-test-slave-7z32 krb5kdc[18105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017075, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:15.235975 18266 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:51:15.237299 18266 webserver.cc:460] Webserver started at http://127.26.172.193:44819/ using document root <none> and password file <none>
I20260806 11:51:15.238163 18266 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:15.238246 18266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:15.238466 18266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:15.240918 18266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "f2f1d17e080248ccb8686170402e8346"
format_stamp: "Formatted at 2026-08-06 11:51:15 on dist-test-slave-7z32"
server_key: "6bc8e30b86e4d499a4da8d52bba0e58d"
server_key_iv: "825cd6a583e0165ab7de85e9d36e3df8"
server_key_version: "encryptionkey@0"
I20260806 11:51:15.241505 18266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "f2f1d17e080248ccb8686170402e8346"
format_stamp: "Formatted at 2026-08-06 11:51:15 on dist-test-slave-7z32"
server_key: "6bc8e30b86e4d499a4da8d52bba0e58d"
server_key_iv: "825cd6a583e0165ab7de85e9d36e3df8"
server_key_version: "encryptionkey@0"
I20260806 11:51:15.246398 18266 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:51:15.249728 18288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:15.251812 18266 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 11:51:15.251979 18266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "f2f1d17e080248ccb8686170402e8346"
format_stamp: "Formatted at 2026-08-06 11:51:15 on dist-test-slave-7z32"
server_key: "6bc8e30b86e4d499a4da8d52bba0e58d"
server_key_iv: "825cd6a583e0165ab7de85e9d36e3df8"
server_key_version: "encryptionkey@0"
I20260806 11:51:15.252103 18266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:15.271721 18266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:15.275429 18266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:15.275619 18266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:15.276217 18266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:15.277304 18266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:15.277361 18266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:15.277405 18266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:15.277477 18266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:15.288584 18266 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:45319
I20260806 11:51:15.288802 18446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:45319 every 8 connection(s)
I20260806 11:51:15.289774 18266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:51:15.290688 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 18266
I20260806 11:51:15.290926 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:51:15.291359 27315 external_mini_cluster.cc:1428] Setting key 41e2c921accefeb38ef0a778918acfa7
Aug 06 11:51:15 dist-test-slave-7z32 krb5kdc[18105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017075, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:51:15.309407 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.292780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:50457 (local address 127.26.172.254:33493)
0806 11:51:15.292928 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:15.292933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:15.294324 (+ 1391us) server_negotiation.cc:407] Connection header received
0806 11:51:15.295971 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:15.295974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:15.296030 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:15.296116 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:15.297466 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.298014 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.299344 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.299590 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.299713 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.303584 (+ 3871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:15.303589 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:15.303591 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:15.303622 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:15.305561 (+ 1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:15.306440 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:15.306444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:15.306445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:15.306554 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:15.307196 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:15.307201 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:15.307203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:15.307485 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:15.307580 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:15.308910 (+ 1330us) server_negotiation.cc:299] Negotiation successful
0806 11:51:15.309141 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 11:51:15.310611 18450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.293380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33493 (local address 127.26.172.193:50457)
0806 11:51:15.294141 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:15.294207 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:15.295729 (+ 1522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:15.296319 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:15.296327 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:15.296739 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:15.297281 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.297297 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.298166 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.298170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.299207 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.299218 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.299775 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.299779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.300083 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.301004 (+ 921us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:51:15.301024 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:15.303326 (+ 2302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:15.305785 (+ 2459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:15.305795 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:15.305821 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:15.306260 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:15.306706 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:15.306709 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:15.306712 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:15.307045 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:15.307627 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:15.307636 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:15.308465 (+ 829us) client_negotiation.cc:769] Sending connection context
0806 11:51:15.308795 (+ 330us) client_negotiation.cc:240] Negotiation successful
0806 11:51:15.309255 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":202,"threads_started":1}
I20260806 11:51:15.312788 18447 heartbeater.cc:347] Connected to a master server at 127.26.172.254:33493
I20260806 11:51:15.313200 18447 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:15.314062 18447 heartbeater.cc:511] Master 127.26.172.254:33493 requested a full tablet report, sending...
I20260806 11:51:15.316402 18170 ts_manager.cc:194] Registered new tserver with Master: f2f1d17e080248ccb8686170402e8346 (127.26.172.193:45319)
I20260806 11:51:15.317768 18170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:50457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:51:15.335193 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33493
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:15.480687 18453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:15.481099 18453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:15.481153 18453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:15.486320 18453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:15.486428 18453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:15.486503 18453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:51:15.492879 18453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:15.494478 18453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:15.496008 18453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:15.508744 18463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:15.508756 18460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:15.508749 18465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:15.509838 18453 server_base.cc:1034] running on GCE node
I20260806 11:51:15.510438 18453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:15.511349 18453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:15.512560 18453 hybrid_clock.cc:648] HybridClock initialized: now 1786017075512526 us; error 66 us; skew 500 ppm
Aug 06 11:51:15 dist-test-slave-7z32 krb5kdc[18105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017075, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:15.516520 18453 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:51:15.517747 18453 webserver.cc:460] Webserver started at http://127.26.172.194:38763/ using document root <none> and password file <none>
I20260806 11:51:15.518496 18453 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:15.518608 18453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:15.518958 18453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:15.521579 18453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "16eea16a963540e89b7088704f67f470"
format_stamp: "Formatted at 2026-08-06 11:51:15 on dist-test-slave-7z32"
server_key: "31710a5f18b39cae2c3db4bd2dad1d00"
server_key_iv: "57b5cfb83bf44433ff11b651550e7781"
server_key_version: "encryptionkey@0"
I20260806 11:51:15.522269 18453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "16eea16a963540e89b7088704f67f470"
format_stamp: "Formatted at 2026-08-06 11:51:15 on dist-test-slave-7z32"
server_key: "31710a5f18b39cae2c3db4bd2dad1d00"
server_key_iv: "57b5cfb83bf44433ff11b651550e7781"
server_key_version: "encryptionkey@0"
I20260806 11:51:15.527386 18453 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 11:51:15.531505 18477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:15.533504 18453 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:15.533811 18453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "16eea16a963540e89b7088704f67f470"
format_stamp: "Formatted at 2026-08-06 11:51:15 on dist-test-slave-7z32"
server_key: "31710a5f18b39cae2c3db4bd2dad1d00"
server_key_iv: "57b5cfb83bf44433ff11b651550e7781"
server_key_version: "encryptionkey@0"
I20260806 11:51:15.533974 18453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:15.562595 18453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:15.566700 18453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:15.566963 18453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:15.567665 18453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:15.568662 18453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:15.568760 18453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:15.568838 18453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:15.568890 18453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:15.580566 18453 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:38685
I20260806 11:51:15.580652 18649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:38685 every 8 connection(s)
I20260806 11:51:15.581743 18453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:51:15.587248 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 18453
I20260806 11:51:15.587430 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:51:15.587777 27315 external_mini_cluster.cc:1428] Setting key 1b5b20753299b68406179e970787372a
Aug 06 11:51:15 dist-test-slave-7z32 krb5kdc[18105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017075, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:15.603101 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.584703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:34799 (local address 127.26.172.254:33493)
0806 11:51:15.584894 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:15.584898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:15.586149 (+ 1251us) server_negotiation.cc:407] Connection header received
0806 11:51:15.588274 (+ 2125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:15.588281 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:15.588378 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:15.588539 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:15.590301 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.590982 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.592892 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.593345 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.593501 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.597338 (+ 3837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:15.597343 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:15.597347 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:15.597403 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:15.599799 (+ 2396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:15.600648 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:15.600653 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:15.600656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:15.600801 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:15.601292 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:15.601298 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:15.601302 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:15.601663 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:15.601817 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:15.602564 (+ 747us) server_negotiation.cc:299] Negotiation successful
0806 11:51:15.602807 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:51:15.603972 18652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.585177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33493 (local address 127.26.172.194:34799)
0806 11:51:15.585904 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:15.586002 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:15.587863 (+ 1861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:15.588892 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:15.588901 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:15.589313 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:15.590108 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.590131 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.591157 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.591164 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.592716 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.592728 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.593559 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.593563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.593731 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.594629 (+ 898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:51:15.594648 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:15.597053 (+ 2405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:15.600034 (+ 2981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:15.600042 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:15.600063 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:15.600489 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:15.600972 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:15.600975 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:15.600976 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:15.601153 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:15.601841 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:15.601874 (+ 33us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:15.602205 (+ 331us) client_negotiation.cc:769] Sending connection context
0806 11:51:15.602450 (+ 245us) client_negotiation.cc:240] Negotiation successful
0806 11:51:15.602800 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":197,"threads_started":1}
I20260806 11:51:15.605795 18650 heartbeater.cc:347] Connected to a master server at 127.26.172.254:33493
I20260806 11:51:15.606164 18650 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:15.607255 18650 heartbeater.cc:511] Master 127.26.172.254:33493 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:51:15.608824 18170 ts_manager.cc:194] Registered new tserver with Master: 16eea16a963540e89b7088704f67f470 (127.26.172.194:38685)
I20260806 11:51:15.609565 18170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:34799
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:51:15.632030 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33493
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:44641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:15.787088 18655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:15.787492 18655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:15.787544 18655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:15.792388 18655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:15.792497 18655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:15.792573 18655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:51:15.799166 18655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:44641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:33493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:15.800786 18655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:15.802237 18655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:15.815176 18665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:15.815233 18660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:15.815198 18662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:15.815675 18655 server_base.cc:1034] running on GCE node
I20260806 11:51:15.816532 18655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:15.817451 18655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:15.818711 18655 hybrid_clock.cc:648] HybridClock initialized: now 1786017075818681 us; error 44 us; skew 500 ppm
Aug 06 11:51:15 dist-test-slave-7z32 krb5kdc[18105](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017075, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:15.823033 18655 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:51:15.824523 18655 webserver.cc:460] Webserver started at http://127.26.172.195:34881/ using document root <none> and password file <none>
I20260806 11:51:15.825385 18655 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:15.825472 18655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:15.825716 18655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:15.828763 18655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "e3d9cb859d3a4422b055aea82f66be1e"
format_stamp: "Formatted at 2026-08-06 11:51:15 on dist-test-slave-7z32"
server_key: "9541467b3d89641b28678685d2032de8"
server_key_iv: "7f896fc7b9b64d11590f96b6c40f441b"
server_key_version: "encryptionkey@0"
I20260806 11:51:15.829569 18655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "e3d9cb859d3a4422b055aea82f66be1e"
format_stamp: "Formatted at 2026-08-06 11:51:15 on dist-test-slave-7z32"
server_key: "9541467b3d89641b28678685d2032de8"
server_key_iv: "7f896fc7b9b64d11590f96b6c40f441b"
server_key_version: "encryptionkey@0"
I20260806 11:51:15.834930 18655 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260806 11:51:15.838420 18674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:15.840488 18655 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260806 11:51:15.840711 18655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "e3d9cb859d3a4422b055aea82f66be1e"
format_stamp: "Formatted at 2026-08-06 11:51:15 on dist-test-slave-7z32"
server_key: "9541467b3d89641b28678685d2032de8"
server_key_iv: "7f896fc7b9b64d11590f96b6c40f441b"
server_key_version: "encryptionkey@0"
I20260806 11:51:15.840909 18655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:15.856844 18655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:15.861359 18655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:15.861747 18655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:15.862597 18655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:15.863826 18655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:15.863910 18655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:15.863994 18655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:15.864039 18655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:15.876878 18655 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:33067
I20260806 11:51:15.876936 18843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:33067 every 8 connection(s)
I20260806 11:51:15.878188 18655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:51:15.884236 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 18655
I20260806 11:51:15.884426 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:51:15.884785 27315 external_mini_cluster.cc:1428] Setting key bf6b6c5117a34e31024dacaff82907c2
Aug 06 11:51:15 dist-test-slave-7z32 krb5kdc[18105](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017075, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:15.896180 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.880944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:39209 (local address 127.26.172.254:33493)
0806 11:51:15.881163 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:15.881169 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:15.882469 (+ 1300us) server_negotiation.cc:407] Connection header received
0806 11:51:15.884193 (+ 1724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:15.884197 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:15.884267 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:15.884357 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:15.886050 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.886866 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.888320 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.888562 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.888662 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.891761 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:15.891764 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:15.891767 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:15.891800 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:15.893502 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:15.894204 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:15.894207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:15.894210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:15.894298 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:15.894736 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:15.894738 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:15.894739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:15.895127 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:15.895217 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:15.895894 (+ 677us) server_negotiation.cc:299] Negotiation successful
0806 11:51:15.896029 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 11:51:15.897341 18850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.881610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:33493 (local address 127.26.172.195:39209)
0806 11:51:15.882251 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:15.882309 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:15.883918 (+ 1609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:15.884612 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:15.884624 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:15.885149 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:15.885813 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.885830 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.887018 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.887021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.888185 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.888197 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.888727 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.888730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.888900 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.889593 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:51:15.889611 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:15.891547 (+ 1936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:15.893651 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:15.893659 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:15.893677 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:15.894077 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:15.894408 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:15.894411 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:15.894413 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:15.894617 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:15.895251 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:15.895259 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:15.895615 (+ 356us) client_negotiation.cc:769] Sending connection context
0806 11:51:15.895844 (+ 229us) client_negotiation.cc:240] Negotiation successful
0806 11:51:15.896225 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":143,"threads_started":1}
I20260806 11:51:15.899390 18846 heartbeater.cc:347] Connected to a master server at 127.26.172.254:33493
I20260806 11:51:15.899816 18846 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:15.900712 18846 heartbeater.cc:511] Master 127.26.172.254:33493 requested a full tablet report, sending...
I20260806 11:51:15.902077 18170 ts_manager.cc:194] Registered new tserver with Master: e3d9cb859d3a4422b055aea82f66be1e (127.26.172.195:33067)
I20260806 11:51:15.902792 18170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:39209
I20260806 11:51:15.913261 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:51:15.924525 18233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.915602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47000 (local address 127.26.172.254:33493)
0806 11:51:15.915763 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:15.915767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:15.915893 (+ 126us) server_negotiation.cc:407] Connection header received
0806 11:51:15.916018 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:15.916021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:15.916076 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:15.916162 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:15.917000 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.917585 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.918586 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.918810 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.918958 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.920655 (+ 1697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:15.920658 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:15.920661 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:15.920689 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:15.922472 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:15.923051 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:15.923054 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:15.923055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:15.923153 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:15.923452 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:15.923454 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:15.923455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:15.923756 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:15.923879 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:15.924218 (+ 339us) server_negotiation.cc:299] Negotiation successful
0806 11:51:15.924363 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 11:51:15.930543 18170 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:51:15.934584 18170 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:51:15.954006 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.947139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59230 (local address 127.26.172.193:45319)
0806 11:51:15.947653 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:15.947661 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:15.947901 (+ 240us) server_negotiation.cc:407] Connection header received
0806 11:51:15.948268 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:15.948277 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:15.948686 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:15.948822 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:15.949462 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.950310 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.951782 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.952797 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.952945 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.953122 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:15.953626 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 11:51:15.953789 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":117,"threads_started":1}
I20260806 11:51:15.954039 18868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.946742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:38685 (local address 127.0.0.1:38940)
0806 11:51:15.947881 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:15.947897 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:15.948052 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:15.949050 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:15.949057 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:15.949083 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:15.949325 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.949334 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.951107 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.951111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.952111 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.952123 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.953432 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.953436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.953571 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.953603 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 11:51:15.953708 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 11:51:15.953874 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1052,"mutex_wait_us":22,"spinlock_wait_cycles":2432,"thread_start_us":212,"threads_started":1}
I20260806 11:51:15.954036 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.947008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38940 (local address 127.26.172.194:38685)
0806 11:51:15.948424 (+ 1416us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:15.948507 (+ 83us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:15.948580 (+ 73us) server_negotiation.cc:407] Connection header received
0806 11:51:15.948673 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:15.948678 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:15.948863 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:15.949041 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:15.949489 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.950925 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.952300 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.953274 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.953455 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.953626 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:15.953742 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 11:51:15.953852 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1282,"thread_start_us":137,"threads_started":1}
I20260806 11:51:15.955178 18866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.946719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:45319 (local address 127.0.0.1:59230)
0806 11:51:15.947728 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:15.947798 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:15.948052 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:15.949078 (+ 1026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:15.949081 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:15.949105 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:15.949288 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.949295 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.950437 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.950439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.951611 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.951622 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.953196 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.953211 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.953347 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.953390 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 11:51:15.954937 (+ 1547us) client_negotiation.cc:240] Negotiation successful
0806 11:51:15.955037 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"spinlock_wait_cycles":12032,"thread_start_us":132,"threads_started":1}
I20260806 11:51:15.956295 18872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.947657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:33067 (local address 127.0.0.1:37676)
0806 11:51:15.948644 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:15.948657 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:15.948792 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:15.949385 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:15.949391 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:15.949423 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:15.949541 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.949548 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.951107 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.951111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.953665 (+ 2554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:15.953675 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.955795 (+ 2120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.955799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:15.955941 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.955972 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 11:51:15.956075 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 11:51:15.956161 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":908,"mutex_wait_us":4,"thread_start_us":152,"threads_started":1}
I20260806 11:51:15.956879 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:15.947823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37676 (local address 127.26.172.195:33067)
0806 11:51:15.948288 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:15.948306 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:15.948772 (+ 466us) server_negotiation.cc:407] Connection header received
0806 11:51:15.948929 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:15.948934 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:15.949189 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:15.949384 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:15.949679 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.950925 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.953833 (+ 2908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:15.954776 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:15.954986 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:15.955105 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:15.956120 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0806 11:51:15.956275 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":112,"threads_started":1}
I20260806 11:51:15.958122 18547 tablet_service.cc:1467] Processing CreateTablet for tablet b9dcad70b92d45f781d8481da88c74c2 (DEFAULT_TABLE table=test-table [id=303409243a3847ed9f0c3a12974a261c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:15.959139 18356 tablet_service.cc:1467] Processing CreateTablet for tablet b9dcad70b92d45f781d8481da88c74c2 (DEFAULT_TABLE table=test-table [id=303409243a3847ed9f0c3a12974a261c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:15.959611 18547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9dcad70b92d45f781d8481da88c74c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:15.960352 18356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9dcad70b92d45f781d8481da88c74c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:15.960556 18749 tablet_service.cc:1467] Processing CreateTablet for tablet b9dcad70b92d45f781d8481da88c74c2 (DEFAULT_TABLE table=test-table [id=303409243a3847ed9f0c3a12974a261c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:15.961825 18749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9dcad70b92d45f781d8481da88c74c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:15.968174 18876 tablet_bootstrap.cc:492] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346: Bootstrap starting.
I20260806 11:51:15.970319 18877 tablet_bootstrap.cc:492] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: Bootstrap starting.
I20260806 11:51:15.971109 18878 tablet_bootstrap.cc:492] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: Bootstrap starting.
I20260806 11:51:15.971998 18876 tablet_bootstrap.cc:654] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:15.972977 18877 tablet_bootstrap.cc:654] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:15.973220 18876 log.cc:824] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:15.973820 18878 tablet_bootstrap.cc:654] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:15.974596 18877 log.cc:824] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:15.975957 18878 log.cc:824] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:15.976245 18876 tablet_bootstrap.cc:492] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346: No bootstrap required, opened a new log
I20260806 11:51:15.976522 18876 ts_tablet_manager.cc:1397] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 11:51:15.977351 18877 tablet_bootstrap.cc:492] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: No bootstrap required, opened a new log
I20260806 11:51:15.977653 18877 ts_tablet_manager.cc:1397] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 11:51:15.978492 18878 tablet_bootstrap.cc:492] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: No bootstrap required, opened a new log
I20260806 11:51:15.978724 18878 ts_tablet_manager.cc:1397] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 11:51:15.981980 18877 raft_consensus.cc:348] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 } } peers { permanent_uuid: "f2f1d17e080248ccb8686170402e8346" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45319 } } peers { permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 } }
I20260806 11:51:15.982342 18877 raft_consensus.cc:374] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:15.982084 18876 raft_consensus.cc:348] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 } } peers { permanent_uuid: "f2f1d17e080248ccb8686170402e8346" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45319 } } peers { permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 } }
I20260806 11:51:15.982414 18877 raft_consensus.cc:729] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16eea16a963540e89b7088704f67f470, State: Initialized, Role: FOLLOWER
I20260806 11:51:15.982471 18876 raft_consensus.cc:374] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:15.982564 18876 raft_consensus.cc:729] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2f1d17e080248ccb8686170402e8346, State: Initialized, Role: FOLLOWER
I20260806 11:51:15.983085 18877 consensus_queue.cc:260] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 } } peers { permanent_uuid: "f2f1d17e080248ccb8686170402e8346" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45319 } } peers { permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 } }
I20260806 11:51:15.983182 18876 consensus_queue.cc:260] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 } } peers { permanent_uuid: "f2f1d17e080248ccb8686170402e8346" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45319 } } peers { permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 } }
I20260806 11:51:15.983964 18878 raft_consensus.cc:348] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 } } peers { permanent_uuid: "f2f1d17e080248ccb8686170402e8346" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45319 } } peers { permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 } }
I20260806 11:51:15.984227 18650 heartbeater.cc:503] Master 127.26.172.254:33493 was elected leader, sending a full tablet report...
I20260806 11:51:15.984342 18878 raft_consensus.cc:374] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:15.984409 18878 raft_consensus.cc:729] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3d9cb859d3a4422b055aea82f66be1e, State: Initialized, Role: FOLLOWER
I20260806 11:51:15.984488 18877 ts_tablet_manager.cc:1428] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 11:51:15.984969 18878 consensus_queue.cc:260] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 } } peers { permanent_uuid: "f2f1d17e080248ccb8686170402e8346" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45319 } } peers { permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 } }
I20260806 11:51:15.985567 18876 ts_tablet_manager.cc:1428] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346: Time spent starting tablet: real 0.009s user 0.000s sys 0.009s
I20260806 11:51:15.986013 18447 heartbeater.cc:503] Master 127.26.172.254:33493 was elected leader, sending a full tablet report...
I20260806 11:51:15.986784 18846 heartbeater.cc:503] Master 127.26.172.254:33493 was elected leader, sending a full tablet report...
I20260806 11:51:15.987057 18878 ts_tablet_manager.cc:1428] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
W20260806 11:51:16.042495 18448 tablet.cc:2369] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:51:16.083498 18651 tablet.cc:2369] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:51:16.129680 18848 tablet.cc:2369] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:51:16.261176 18884 raft_consensus.cc:482] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:16.261531 18884 raft_consensus.cc:504] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 } } peers { permanent_uuid: "f2f1d17e080248ccb8686170402e8346" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45319 } } peers { permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 } }
I20260806 11:51:16.263176 18884 leader_election.cc:288] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16eea16a963540e89b7088704f67f470 (127.26.172.194:38685), e3d9cb859d3a4422b055aea82f66be1e (127.26.172.195:33067)
I20260806 11:51:16.268551 18888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:16.264083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:33067 (local address 127.26.172.193:49831)
0806 11:51:16.264426 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:16.264444 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:16.264607 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:16.264933 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:16.264936 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:16.264956 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:16.265141 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:16.265148 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.266000 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.266004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:16.267243 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:16.267253 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.268160 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.268167 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:16.268272 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:16.268292 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 11:51:16.268366 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 11:51:16.268434 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":1,"thread_start_us":103,"threads_started":1}
I20260806 11:51:16.268563 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:16.263814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:51523 (local address 127.26.172.194:38685)
0806 11:51:16.263988 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:16.263992 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:16.264093 (+ 101us) server_negotiation.cc:407] Connection header received
0806 11:51:16.264347 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:16.264351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:16.264422 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:16.264469 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:16.264892 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.265456 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.267113 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.267721 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.267812 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:16.267868 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:16.268258 (+ 390us) server_negotiation.cc:299] Negotiation successful
0806 11:51:16.268399 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 11:51:16.268606 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:16.264300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:49831 (local address 127.26.172.195:33067)
0806 11:51:16.264443 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:16.264448 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:16.264558 (+ 110us) server_negotiation.cc:407] Connection header received
0806 11:51:16.264755 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:16.264759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:16.264820 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:16.264916 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:16.265273 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.265863 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.267466 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.267988 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.268131 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:16.268227 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:16.268402 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 11:51:16.268488 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 11:51:16.268558 18886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:16.263594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:38685 (local address 127.26.172.193:51523)
0806 11:51:16.263959 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:16.263978 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:16.264145 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:16.264614 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:16.264616 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:16.264635 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:16.264767 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:16.264772 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.265585 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.265589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:16.266936 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:16.266948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.267961 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.267963 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:16.268044 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:16.268099 (+ 55us) client_negotiation.cc:769] Sending connection context
0806 11:51:16.268193 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 11:51:16.268298 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":48,"thread_start_us":146,"threads_started":1}
I20260806 11:51:16.269773 18773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9dcad70b92d45f781d8481da88c74c2" candidate_uuid: "f2f1d17e080248ccb8686170402e8346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3d9cb859d3a4422b055aea82f66be1e" is_pre_election: true
I20260806 11:51:16.269773 18577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9dcad70b92d45f781d8481da88c74c2" candidate_uuid: "f2f1d17e080248ccb8686170402e8346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16eea16a963540e89b7088704f67f470" is_pre_election: true
I20260806 11:51:16.270179 18577 raft_consensus.cc:2454] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2f1d17e080248ccb8686170402e8346 in term 0.
I20260806 11:51:16.270179 18773 raft_consensus.cc:2454] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2f1d17e080248ccb8686170402e8346 in term 0.
I20260806 11:51:16.270879 18293 leader_election.cc:302] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3d9cb859d3a4422b055aea82f66be1e, f2f1d17e080248ccb8686170402e8346; no voters:
I20260806 11:51:16.271248 18884 raft_consensus.cc:2781] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:51:16.271417 18884 raft_consensus.cc:482] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:51:16.271495 18884 raft_consensus.cc:3037] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:16.273115 18884 raft_consensus.cc:504] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 } } peers { permanent_uuid: "f2f1d17e080248ccb8686170402e8346" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45319 } } peers { permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 } }
I20260806 11:51:16.273633 18884 leader_election.cc:288] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [CANDIDATE]: Term 1 election: Requested vote from peers 16eea16a963540e89b7088704f67f470 (127.26.172.194:38685), e3d9cb859d3a4422b055aea82f66be1e (127.26.172.195:33067)
I20260806 11:51:16.274309 18577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9dcad70b92d45f781d8481da88c74c2" candidate_uuid: "f2f1d17e080248ccb8686170402e8346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16eea16a963540e89b7088704f67f470"
I20260806 11:51:16.274309 18773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9dcad70b92d45f781d8481da88c74c2" candidate_uuid: "f2f1d17e080248ccb8686170402e8346" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3d9cb859d3a4422b055aea82f66be1e"
I20260806 11:51:16.274499 18577 raft_consensus.cc:3037] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:16.274518 18773 raft_consensus.cc:3037] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:16.276120 18773 raft_consensus.cc:2454] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2f1d17e080248ccb8686170402e8346 in term 1.
I20260806 11:51:16.276120 18577 raft_consensus.cc:2454] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2f1d17e080248ccb8686170402e8346 in term 1.
I20260806 11:51:16.276608 18293 leader_election.cc:302] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16eea16a963540e89b7088704f67f470, f2f1d17e080248ccb8686170402e8346; no voters:
I20260806 11:51:16.276836 18884 raft_consensus.cc:2781] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:16.277113 18884 raft_consensus.cc:686] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 1 LEADER]: Becoming Leader. State: Replica: f2f1d17e080248ccb8686170402e8346, State: Running, Role: LEADER
I20260806 11:51:16.277529 18884 consensus_queue.cc:237] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 } } peers { permanent_uuid: "f2f1d17e080248ccb8686170402e8346" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45319 } } peers { permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 } }
I20260806 11:51:16.281394 18168 catalog_manager.cc:5495] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2f1d17e080248ccb8686170402e8346 (127.26.172.193). New cstate: current_term: 1 leader_uuid: "f2f1d17e080248ccb8686170402e8346" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2f1d17e080248ccb8686170402e8346" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 45319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 } health_report { overall_health: UNKNOWN } } }
I20260806 11:51:16.343530 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:16.339574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59236 (local address 127.26.172.193:45319)
0806 11:51:16.339740 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:16.339745 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:16.339763 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:51:16.339884 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:16.339887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:16.339970 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:16.340094 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:51:16.340336 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.340892 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.341774 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.341999 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.342083 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:16.342403 (+ 320us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:51:16.343120 (+ 717us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:51:16.343248 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:16.343293 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 11:51:16.343368 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 11:51:16.351964 18773 raft_consensus.cc:1261] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e [term 1 FOLLOWER]: Refusing update from remote peer f2f1d17e080248ccb8686170402e8346: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:16.351964 18577 raft_consensus.cc:1261] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470 [term 1 FOLLOWER]: Refusing update from remote peer f2f1d17e080248ccb8686170402e8346: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:16.352983 18889 consensus_queue.cc:1035] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16eea16a963540e89b7088704f67f470" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 38685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:16.353238 18884 consensus_queue.cc:1035] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3d9cb859d3a4422b055aea82f66be1e" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 33067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:16.361881 18892 mvcc.cc:205] Tried to move back new op lower bound from 7315525944726462464 to 7315525944436019200. Current Snapshot: MvccSnapshot[applied={T|T < 7315525944726462464}]
I20260806 11:51:16.363420 18893 mvcc.cc:205] Tried to move back new op lower bound from 7315525944726462464 to 7315525944436019200. Current Snapshot: MvccSnapshot[applied={T|T < 7315525944726462464}]
I20260806 11:51:16.373740 18168 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:16.373973 18168 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:16.377440 18168 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c6e81318c42847c48076484b9849f239: Sending DeleteTablet for 3 replicas of tablet b9dcad70b92d45f781d8481da88c74c2
I20260806 11:51:16.378499 18547 tablet_service.cc:1514] Processing DeleteTablet for tablet b9dcad70b92d45f781d8481da88c74c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:16 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:38940
I20260806 11:51:16.378533 18356 tablet_service.cc:1514] Processing DeleteTablet for tablet b9dcad70b92d45f781d8481da88c74c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:16 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:59230
I20260806 11:51:16.378698 18749 tablet_service.cc:1514] Processing DeleteTablet for tablet b9dcad70b92d45f781d8481da88c74c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:16 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:37676
I20260806 11:51:16.379170 18906 tablet_replica.cc:330] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: stopping tablet replica
I20260806 11:51:16.379258 18909 tablet_replica.cc:330] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346: stopping tablet replica
I20260806 11:51:16.379678 18909 raft_consensus.cc:2229] T b9dcad70b92d45f781d8481da88c74c2 P f2f1d17e080248ccb8686170402e8346 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:51:16.379873 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 18266
I20260806 11:51:16.379882 18910 tablet_replica.cc:330] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: stopping tablet replica
I20260806 11:51:16.380299 18910 raft_consensus.cc:2229] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:16.380856 18910 raft_consensus.cc:2258] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:16.384500 18906 raft_consensus.cc:2229] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:16.385075 18906 raft_consensus.cc:2258] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:16.385291 18910 ts_tablet_manager.cc:1905] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:16.387820 18906 ts_tablet_manager.cc:1905] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:16.388567 18910 ts_tablet_manager.cc:1918] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:16.388703 18910 log.cc:1196] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/b9dcad70b92d45f781d8481da88c74c2
I20260806 11:51:16.389021 18910 ts_tablet_manager.cc:1939] T b9dcad70b92d45f781d8481da88c74c2 P e3d9cb859d3a4422b055aea82f66be1e: Deleting consensus metadata
I20260806 11:51:16.390456 18153 catalog_manager.cc:4841] TS e3d9cb859d3a4422b055aea82f66be1e (127.26.172.195:33067): tablet b9dcad70b92d45f781d8481da88c74c2 (table test-table [id=303409243a3847ed9f0c3a12974a261c]) successfully deleted
I20260806 11:51:16.392119 18906 ts_tablet_manager.cc:1918] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:16.392289 18906 log.cc:1196] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/b9dcad70b92d45f781d8481da88c74c2
I20260806 11:51:16.392670 18906 ts_tablet_manager.cc:1939] T b9dcad70b92d45f781d8481da88c74c2 P 16eea16a963540e89b7088704f67f470: Deleting consensus metadata
I20260806 11:51:16.394690 18153 catalog_manager.cc:4841] TS 16eea16a963540e89b7088704f67f470 (127.26.172.194:38685): tablet b9dcad70b92d45f781d8481da88c74c2 (table test-table [id=303409243a3847ed9f0c3a12974a261c]) successfully deleted
W20260806 11:51:16.397529 18149 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:45319 (error 108)
I20260806 11:51:16.397796 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 18453
I20260806 11:51:16.404825 18872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:16.404459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:45319 (local address 127.0.0.1:59242)
0806 11:51:16.404623 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:16.404708 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:45319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 11:51:16.406288 18149 catalog_manager.cc:4584] TS f2f1d17e080248ccb8686170402e8346 (127.26.172.193:45319): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b9dcad70b92d45f781d8481da88c74c2: Network error: Client connection negotiation failed: client connection to 127.26.172.193:45319: connect: Connection refused (error 111)
I20260806 11:51:16.414994 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 18655
I20260806 11:51:16.429805 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 18127
2026-08-06T11:51:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (3239 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T11:51:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:16Z Disabled control of system clock
I20260806 11:51:16.473946 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:41153
--webserver_interface=127.26.172.254
--webserver_port=0
--builtin_ntp_servers=127.26.172.212:38641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:41153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 11:51:16.601301 18923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:16.601620 18923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:16.601658 18923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:16.605862 18923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:16.605952 18923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:16.605968 18923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:16.605993 18923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:16.606009 18923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:16.611164 18923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:41153
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:41153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:16.612425 18923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:16.613935 18923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:16.623833 18934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:16.623833 18928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:16.623837 18930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:16.624390 18923 server_base.cc:1034] running on GCE node
I20260806 11:51:16.625174 18923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:16.626741 18923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:16.627965 18923 hybrid_clock.cc:648] HybridClock initialized: now 1786017076627925 us; error 62 us; skew 500 ppm
I20260806 11:51:16.630568 18923 webserver.cc:460] Webserver started at http://127.26.172.254:34617/ using document root <none> and password file <none>
I20260806 11:51:16.631438 18923 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:16.631553 18923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:16.631872 18923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:16.634560 18923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "cf3a107eba964f2d8b899527dbb8783d"
format_stamp: "Formatted at 2026-08-06 11:51:16 on dist-test-slave-7z32"
server_key: "a279c426b6ac058e1c72cea3f8874805"
server_key_iv: "32a76f8cab7169364b6f5ca6edad746d"
server_key_version: "encryptionkey@0"
I20260806 11:51:16.635298 18923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "cf3a107eba964f2d8b899527dbb8783d"
format_stamp: "Formatted at 2026-08-06 11:51:16 on dist-test-slave-7z32"
server_key: "a279c426b6ac058e1c72cea3f8874805"
server_key_iv: "32a76f8cab7169364b6f5ca6edad746d"
server_key_version: "encryptionkey@0"
I20260806 11:51:16.640316 18923 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:51:16.643889 18942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:16.645980 18923 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:51:16.646261 18923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "cf3a107eba964f2d8b899527dbb8783d"
format_stamp: "Formatted at 2026-08-06 11:51:16 on dist-test-slave-7z32"
server_key: "a279c426b6ac058e1c72cea3f8874805"
server_key_iv: "32a76f8cab7169364b6f5ca6edad746d"
server_key_version: "encryptionkey@0"
I20260806 11:51:16.646454 18923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:16.663627 18923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:16.664557 18923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:16.664803 18923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:16.673635 18923 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:41153
I20260806 11:51:16.673839 19021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:41153 every 8 connection(s)
I20260806 11:51:16.674793 18923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:16.679544 19023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:16.682706 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 18923
I20260806 11:51:16.682937 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:16.683336 27315 external_mini_cluster.cc:1428] Setting key 8853ee0c9c862fa43658e489d2ad622f
I20260806 11:51:16.688199 19023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d: Bootstrap starting.
I20260806 11:51:16.691514 19023 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:16.692589 19023 log.cc:824] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:16.694387 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:16.685289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45762 (local address 127.26.172.254:41153)
0806 11:51:16.686065 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:16.686083 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:16.686124 (+ 41us) server_negotiation.cc:407] Connection header received
0806 11:51:16.687102 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:16.687125 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:16.687613 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:16.688013 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:16.688544 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.689619 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.690542 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.691139 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.691328 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:16.692332 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:16.692338 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:16.692354 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:16.692868 (+ 514us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:16.692942 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:16.692966 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:16.693080 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:16.693231 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 11:51:16.693537 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":166,"threads_started":1}
I20260806 11:51:16.695735 19023 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d: No bootstrap required, opened a new log
I20260806 11:51:16.701189 19023 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3a107eba964f2d8b899527dbb8783d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41153 } }
I20260806 11:51:16.701632 19023 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:16.701699 19023 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf3a107eba964f2d8b899527dbb8783d, State: Initialized, Role: FOLLOWER
I20260806 11:51:16.702320 19023 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3a107eba964f2d8b899527dbb8783d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41153 } }
I20260806 11:51:16.702512 19023 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:16.702577 19023 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:16.702675 19023 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:16.704114 19023 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3a107eba964f2d8b899527dbb8783d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41153 } }
I20260806 11:51:16.704543 19023 leader_election.cc:302] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf3a107eba964f2d8b899527dbb8783d; no voters:
I20260806 11:51:16.704929 19023 leader_election.cc:288] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:16.705196 19029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:16.705647 19029 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [term 1 LEADER]: Becoming Leader. State: Replica: cf3a107eba964f2d8b899527dbb8783d, State: Running, Role: LEADER
I20260806 11:51:16.706120 19029 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3a107eba964f2d8b899527dbb8783d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41153 } }
I20260806 11:51:16.707552 19023 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:16.708469 19030 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf3a107eba964f2d8b899527dbb8783d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3a107eba964f2d8b899527dbb8783d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41153 } } }
I20260806 11:51:16.708669 19030 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:16.708465 19031 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf3a107eba964f2d8b899527dbb8783d. Latest consensus state: current_term: 1 leader_uuid: "cf3a107eba964f2d8b899527dbb8783d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf3a107eba964f2d8b899527dbb8783d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41153 } } }
I20260806 11:51:16.708871 19031 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:16.709170 19038 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:16.713106 19038 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:16.720710 19038 catalog_manager.cc:1347] Generated new cluster ID: b5564f6107a74c8883fb4ff54d417d36
I20260806 11:51:16.720814 19038 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:16.735996 19038 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:16.737777 19038 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:16.749786 19038 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d: Generated new TSK 0
I20260806 11:51:16.750733 19038 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:16.760591 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41153
--builtin_ntp_servers=127.26.172.212:38641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 11:51:16.888715 19056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:16.889096 19056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:16.889138 19056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:16.893251 19056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:16.893318 19056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:16.893378 19056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:51:16.898340 19056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:16.899672 19056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:16.901153 19056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:16.913448 19064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:16.913437 19066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:16.913429 19063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:16.913946 19056 server_base.cc:1034] running on GCE node
I20260806 11:51:16.914795 19056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:16.915923 19056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:16.917270 19056 hybrid_clock.cc:648] HybridClock initialized: now 1786017076917213 us; error 79 us; skew 500 ppm
I20260806 11:51:16.920205 19056 webserver.cc:460] Webserver started at http://127.26.172.193:43723/ using document root <none> and password file <none>
I20260806 11:51:16.921001 19056 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:16.921080 19056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:16.921327 19056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:16.924264 19056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "7ade2862b0f74fab93c5c86bacc85f41"
format_stamp: "Formatted at 2026-08-06 11:51:16 on dist-test-slave-7z32"
server_key: "49ab09e483e11009b77550744b13889a"
server_key_iv: "debaeef079d7dd2283ab222af842935e"
server_key_version: "encryptionkey@0"
I20260806 11:51:16.924969 19056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "7ade2862b0f74fab93c5c86bacc85f41"
format_stamp: "Formatted at 2026-08-06 11:51:16 on dist-test-slave-7z32"
server_key: "49ab09e483e11009b77550744b13889a"
server_key_iv: "debaeef079d7dd2283ab222af842935e"
server_key_version: "encryptionkey@0"
I20260806 11:51:16.930368 19056 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260806 11:51:16.935547 19075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:16.937464 19056 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:16.937675 19056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "7ade2862b0f74fab93c5c86bacc85f41"
format_stamp: "Formatted at 2026-08-06 11:51:16 on dist-test-slave-7z32"
server_key: "49ab09e483e11009b77550744b13889a"
server_key_iv: "debaeef079d7dd2283ab222af842935e"
server_key_version: "encryptionkey@0"
I20260806 11:51:16.937860 19056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:16.966418 19056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:16.967604 19056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:16.967893 19056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:16.968825 19056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:16.970275 19056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:16.970366 19056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:16.970463 19056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:16.970513 19056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:16.985240 19056 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:44137
I20260806 11:51:16.985343 19238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:44137 every 8 connection(s)
I20260806 11:51:16.986711 19056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:51:16.991246 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 19056
I20260806 11:51:16.991422 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:51:16.991803 27315 external_mini_cluster.cc:1428] Setting key 638123cea9cb3a239d5f7a5e6139a2b0
I20260806 11:51:16.994650 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41153
--builtin_ntp_servers=127.26.172.212:38641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 11:51:16.999177 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:16.989393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:37427 (local address 127.26.172.254:41153)
0806 11:51:16.989561 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:16.989565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:16.991306 (+ 1741us) server_negotiation.cc:407] Connection header received
0806 11:51:16.993362 (+ 2056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:16.993366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:16.993479 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:16.993603 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:16.994951 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.995554 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.996781 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.997013 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.997134 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:16.998565 (+ 1431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:16.998568 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:16.998570 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:16.998585 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:16.998605 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:16.998614 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:16.998702 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:16.998956 (+ 254us) server_negotiation.cc:299] Negotiation successful
0806 11:51:16.999023 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 11:51:17.000126 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:16.989965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41153 (local address 127.26.172.193:37427)
0806 11:51:16.991049 (+ 1084us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:16.991122 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:16.993005 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:16.993876 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:16.993888 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:16.994006 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:16.994633 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:16.994647 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.995698 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.995702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:16.996639 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:16.996649 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:16.997190 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:16.997195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:16.997381 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:16.998189 (+ 808us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:51:16.998191 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:16.998235 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:51:16.998374 (+ 139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:16.998711 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:16.998725 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:16.998732 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 11:51:16.998935 (+ 203us) client_negotiation.cc:240] Negotiation successful
0806 11:51:16.999242 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":185,"threads_started":1}
I20260806 11:51:17.001785 19239 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41153
I20260806 11:51:17.002094 19239 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:17.002730 19239 heartbeater.cc:511] Master 127.26.172.254:41153 requested a full tablet report, sending...
I20260806 11:51:17.004509 18959 ts_manager.cc:194] Registered new tserver with Master: 7ade2862b0f74fab93c5c86bacc85f41 (127.26.172.193:44137)
I20260806 11:51:17.005784 18959 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.193:37427
W20260806 11:51:17.146162 19244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:17.146572 19244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:17.146652 19244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:17.152557 19244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:17.152719 19244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:17.152833 19244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:51:17.158665 19244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:17.160375 19244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:17.162313 19244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:17.175992 19258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:17.175997 19251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:17.175992 19255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:17.176962 19244 server_base.cc:1034] running on GCE node
I20260806 11:51:17.177556 19244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:17.178498 19244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:17.179719 19244 hybrid_clock.cc:648] HybridClock initialized: now 1786017077179719 us; error 78 us; skew 500 ppm
I20260806 11:51:17.182292 19244 webserver.cc:460] Webserver started at http://127.26.172.194:44907/ using document root <none> and password file <none>
I20260806 11:51:17.183317 19244 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:17.183468 19244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:17.183830 19244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:17.186776 19244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "a789fefc9d29498081cf531b228b00c9"
format_stamp: "Formatted at 2026-08-06 11:51:17 on dist-test-slave-7z32"
server_key: "ef4160945e64d0d30c6c4d414b55df62"
server_key_iv: "ed816fa30948214a84bb57eea53d48cc"
server_key_version: "encryptionkey@0"
I20260806 11:51:17.187609 19244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "a789fefc9d29498081cf531b228b00c9"
format_stamp: "Formatted at 2026-08-06 11:51:17 on dist-test-slave-7z32"
server_key: "ef4160945e64d0d30c6c4d414b55df62"
server_key_iv: "ed816fa30948214a84bb57eea53d48cc"
server_key_version: "encryptionkey@0"
I20260806 11:51:17.192834 19244 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:51:17.196770 19268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:17.198586 19244 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:17.198895 19244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "a789fefc9d29498081cf531b228b00c9"
format_stamp: "Formatted at 2026-08-06 11:51:17 on dist-test-slave-7z32"
server_key: "ef4160945e64d0d30c6c4d414b55df62"
server_key_iv: "ed816fa30948214a84bb57eea53d48cc"
server_key_version: "encryptionkey@0"
I20260806 11:51:17.199100 19244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:17.225329 19244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:17.226503 19244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:17.226771 19244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:17.227669 19244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:17.229084 19244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:17.229229 19244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:17.229372 19244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:17.229421 19244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:17.242941 19244 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:36741
I20260806 11:51:17.242967 19431 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:36741 every 8 connection(s)
I20260806 11:51:17.244201 19244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:51:17.247237 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 19244
I20260806 11:51:17.247407 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:51:17.247778 27315 external_mini_cluster.cc:1428] Setting key c56b4abe744efaf92646676b617ff548
I20260806 11:51:17.251063 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41153
--builtin_ntp_servers=127.26.172.212:38641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 11:51:17.257216 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.246697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:33655 (local address 127.26.172.254:41153)
0806 11:51:17.247069 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:17.247077 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:17.248200 (+ 1123us) server_negotiation.cc:407] Connection header received
0806 11:51:17.250240 (+ 2040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:17.250244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:17.250316 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:17.250426 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:17.252183 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.253116 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.254487 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.254938 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.255076 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.256433 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:17.256439 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:17.256446 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:17.256469 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:17.256500 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:17.256514 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:17.256606 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:17.256856 (+ 250us) server_negotiation.cc:299] Negotiation successful
0806 11:51:17.256948 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221}
I20260806 11:51:17.258167 19434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.247146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41153 (local address 127.26.172.194:33655)
0806 11:51:17.248001 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:17.248060 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:17.249963 (+ 1903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:17.250611 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:17.250618 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:17.250710 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:17.251934 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.251964 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.253297 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.253300 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.254334 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.254346 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.255132 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.255135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.255297 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.256109 (+ 812us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:51:17.256111 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:17.256157 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:51:17.256240 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:17.256654 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:17.256664 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:17.256671 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 11:51:17.256821 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 11:51:17.257114 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":190,"threads_started":1}
I20260806 11:51:17.259778 19432 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41153
I20260806 11:51:17.260061 19432 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:17.260707 19432 heartbeater.cc:511] Master 127.26.172.254:41153 requested a full tablet report, sending...
I20260806 11:51:17.262006 18959 ts_manager.cc:194] Registered new tserver with Master: a789fefc9d29498081cf531b228b00c9 (127.26.172.194:36741)
I20260806 11:51:17.262735 18959 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.194:33655
W20260806 11:51:17.395138 19436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:17.395548 19436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:17.395601 19436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:17.400590 19436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:17.400668 19436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:17.400736 19436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:51:17.406107 19436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:17.407943 19436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:17.409991 19436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:17.422603 19451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:17.422631 19447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:17.422804 19436 server_base.cc:1034] running on GCE node
W20260806 11:51:17.422585 19449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:17.423521 19436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:17.424400 19436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:17.425637 19436 hybrid_clock.cc:648] HybridClock initialized: now 1786017077425612 us; error 38 us; skew 500 ppm
I20260806 11:51:17.428198 19436 webserver.cc:460] Webserver started at http://127.26.172.195:41629/ using document root <none> and password file <none>
I20260806 11:51:17.428984 19436 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:17.429093 19436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:17.429375 19436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:17.431981 19436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "812ada6d0f3d42d383b43c54965cf535"
format_stamp: "Formatted at 2026-08-06 11:51:17 on dist-test-slave-7z32"
server_key: "131f3d69e6cb455304beeb37e3564446"
server_key_iv: "6e405f19cd666b277af93f4f85914946"
server_key_version: "encryptionkey@0"
I20260806 11:51:17.432643 19436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "812ada6d0f3d42d383b43c54965cf535"
format_stamp: "Formatted at 2026-08-06 11:51:17 on dist-test-slave-7z32"
server_key: "131f3d69e6cb455304beeb37e3564446"
server_key_iv: "6e405f19cd666b277af93f4f85914946"
server_key_version: "encryptionkey@0"
I20260806 11:51:17.437470 19436 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:51:17.440994 19457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:17.442965 19436 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:51:17.443130 19436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "812ada6d0f3d42d383b43c54965cf535"
format_stamp: "Formatted at 2026-08-06 11:51:17 on dist-test-slave-7z32"
server_key: "131f3d69e6cb455304beeb37e3564446"
server_key_iv: "6e405f19cd666b277af93f4f85914946"
server_key_version: "encryptionkey@0"
I20260806 11:51:17.443274 19436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:17.468713 19436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:17.469551 19436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:17.469775 19436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:17.470464 19436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:17.471714 19436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:17.471792 19436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:17.471863 19436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:17.471909 19436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:17.483120 19436 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:43191
I20260806 11:51:17.483243 19617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:43191 every 8 connection(s)
I20260806 11:51:17.484229 19436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:51:17.493052 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 19436
I20260806 11:51:17.493255 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:51:17.493597 27315 external_mini_cluster.cc:1428] Setting key 39351743cce16f792e94c11dc97c6e6c
I20260806 11:51:17.497066 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.486867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:44863 (local address 127.26.172.254:41153)
0806 11:51:17.487055 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:17.487059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:17.488553 (+ 1494us) server_negotiation.cc:407] Connection header received
0806 11:51:17.490426 (+ 1873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:17.490431 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:17.490508 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:17.490636 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:17.491892 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.492507 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.494154 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.494552 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.494737 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.496479 (+ 1742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:17.496483 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:17.496487 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:17.496502 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:17.496535 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:17.496544 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:17.496615 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:17.496863 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 11:51:17.496935 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 11:51:17.498363 19620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.487240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41153 (local address 127.26.172.195:44863)
0806 11:51:17.488305 (+ 1065us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:17.488384 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:17.490120 (+ 1736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:17.490899 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:17.490908 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:17.491024 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:17.491703 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.491719 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.492676 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.492682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.493922 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.493934 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.494933 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.494940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.495180 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.496131 (+ 951us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:51:17.496133 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:17.496192 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:51:17.496299 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:17.496659 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:17.496670 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:17.496677 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 11:51:17.496818 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 11:51:17.497230 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":135,"threads_started":1}
I20260806 11:51:17.499996 19618 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41153
I20260806 11:51:17.500303 19618 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:17.500993 19618 heartbeater.cc:511] Master 127.26.172.254:41153 requested a full tablet report, sending...
I20260806 11:51:17.502485 18959 ts_manager.cc:194] Registered new tserver with Master: 812ada6d0f3d42d383b43c54965cf535 (127.26.172.195:43191)
I20260806 11:51:17.503300 18959 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.195:44863
I20260806 11:51:17.509045 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:51:17.516810 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.511967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45778 (local address 127.26.172.254:41153)
0806 11:51:17.512154 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:17.512159 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:17.512443 (+ 284us) server_negotiation.cc:407] Connection header received
0806 11:51:17.512669 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:17.512673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:17.512765 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:17.512882 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:17.513199 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.513815 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.514758 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.515108 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.515222 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.516188 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:17.516192 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:17.516195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:17.516213 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:17.516239 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:17.516248 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:17.516329 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:17.516575 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 11:51:17.516655 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 11:51:17.520944 18959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45778:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:51:17.524487 18959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:51:17.542703 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.536591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43762 (local address 127.26.172.195:43191)
0806 11:51:17.537528 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:17.537541 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:17.537567 (+ 26us) server_negotiation.cc:407] Connection header received
0806 11:51:17.537654 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:17.537661 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:17.537867 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:17.538046 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:17.538362 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.539408 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.541100 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.541856 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.542176 (+ 320us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.542335 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:17.542465 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 11:51:17.542553 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":816,"thread_start_us":176,"threads_started":1}
I20260806 11:51:17.542760 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.536313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:43191 (local address 127.0.0.1:43762)
0806 11:51:17.536631 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:17.536649 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:17.536770 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:17.538025 (+ 1255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:17.538029 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:17.538049 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:17.538192 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.538200 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.539553 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.539557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.540938 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.540951 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.542004 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.542007 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.542206 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.542264 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 11:51:17.542418 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 11:51:17.542590 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":36,"thread_start_us":136,"threads_started":1}
I20260806 11:51:17.543882 19641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.536707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:36741 (local address 127.0.0.1:56468)
0806 11:51:17.537152 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:17.537167 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:17.537262 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:17.538300 (+ 1038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:17.538303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:17.538325 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:17.538405 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.538413 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.539820 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.539824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.540966 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.540973 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.542003 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.542006 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.543465 (+ 1459us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.543501 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 11:51:17.543579 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 11:51:17.543678 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":54,"thread_start_us":103,"threads_started":1}
I20260806 11:51:17.544135 19642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.537218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56468 (local address 127.26.172.194:36741)
0806 11:51:17.537787 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:17.537804 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:17.537828 (+ 24us) server_negotiation.cc:407] Connection header received
0806 11:51:17.537911 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:17.537916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:17.538102 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:17.538299 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:17.538551 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.539624 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.541137 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.541793 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.542156 (+ 363us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.542460 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:17.543801 (+ 1341us) server_negotiation.cc:299] Negotiation successful
0806 11:51:17.543940 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":188,"threads_started":1}
I20260806 11:51:17.544636 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.535468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:44137 (local address 127.0.0.1:50192)
0806 11:51:17.536023 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:17.536075 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:17.536235 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:17.537290 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:17.537307 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:17.537337 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:17.537557 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.537565 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.539195 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.539199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.540675 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.540685 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.541980 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.541985 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.543472 (+ 1487us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.543509 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 11:51:17.543596 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 11:51:17.543700 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":127,"thread_start_us":112,"threads_started":1}
I20260806 11:51:17.544795 19637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.535722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50192 (local address 127.26.172.193:44137)
0806 11:51:17.536369 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:17.536378 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:17.536414 (+ 36us) server_negotiation.cc:407] Connection header received
0806 11:51:17.536535 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:17.536546 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:17.536865 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:17.537056 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:17.537736 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.539053 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.540856 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.541803 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.541985 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.542210 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:17.544491 (+ 2281us) server_negotiation.cc:299] Negotiation successful
0806 11:51:17.544645 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":181,"threads_started":1}
I20260806 11:51:17.546701 19526 tablet_service.cc:1467] Processing CreateTablet for tablet 4d82edf0411141409428f2efb3770340 (DEFAULT_TABLE table=test-table [id=ce19ec1fa218471a952cf7f7bd50d584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:17.547258 19334 tablet_service.cc:1467] Processing CreateTablet for tablet 4d82edf0411141409428f2efb3770340 (DEFAULT_TABLE table=test-table [id=ce19ec1fa218471a952cf7f7bd50d584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:17.548095 19526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d82edf0411141409428f2efb3770340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:17.548199 19334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d82edf0411141409428f2efb3770340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:17.548020 19152 tablet_service.cc:1467] Processing CreateTablet for tablet 4d82edf0411141409428f2efb3770340 (DEFAULT_TABLE table=test-table [id=ce19ec1fa218471a952cf7f7bd50d584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:17.549307 19152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d82edf0411141409428f2efb3770340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:17.556499 19643 tablet_bootstrap.cc:492] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: Bootstrap starting.
I20260806 11:51:17.557093 19644 tablet_bootstrap.cc:492] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: Bootstrap starting.
I20260806 11:51:17.558117 19645 tablet_bootstrap.cc:492] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41: Bootstrap starting.
I20260806 11:51:17.559978 19644 tablet_bootstrap.cc:654] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:17.560964 19644 log.cc:824] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:17.560962 19645 tablet_bootstrap.cc:654] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:17.560962 19643 tablet_bootstrap.cc:654] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:17.562026 19645 log.cc:824] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:17.562026 19643 log.cc:824] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:17.563762 19644 tablet_bootstrap.cc:492] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: No bootstrap required, opened a new log
I20260806 11:51:17.564042 19644 ts_tablet_manager.cc:1397] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s
I20260806 11:51:17.564677 19645 tablet_bootstrap.cc:492] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41: No bootstrap required, opened a new log
I20260806 11:51:17.564944 19645 ts_tablet_manager.cc:1397] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 11:51:17.565213 19643 tablet_bootstrap.cc:492] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: No bootstrap required, opened a new log
I20260806 11:51:17.565433 19643 ts_tablet_manager.cc:1397] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260806 11:51:17.569443 19645 raft_consensus.cc:348] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 } } peers { permanent_uuid: "812ada6d0f3d42d383b43c54965cf535" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 43191 } } peers { permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 } }
I20260806 11:51:17.569784 19645 raft_consensus.cc:374] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:17.569859 19645 raft_consensus.cc:729] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ade2862b0f74fab93c5c86bacc85f41, State: Initialized, Role: FOLLOWER
I20260806 11:51:17.569731 19644 raft_consensus.cc:348] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 } } peers { permanent_uuid: "812ada6d0f3d42d383b43c54965cf535" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 43191 } } peers { permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 } }
I20260806 11:51:17.570117 19644 raft_consensus.cc:374] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:17.570128 19643 raft_consensus.cc:348] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 } } peers { permanent_uuid: "812ada6d0f3d42d383b43c54965cf535" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 43191 } } peers { permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 } }
I20260806 11:51:17.570333 19644 raft_consensus.cc:729] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 812ada6d0f3d42d383b43c54965cf535, State: Initialized, Role: FOLLOWER
I20260806 11:51:17.570377 19643 raft_consensus.cc:374] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:17.570436 19643 raft_consensus.cc:729] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a789fefc9d29498081cf531b228b00c9, State: Initialized, Role: FOLLOWER
I20260806 11:51:17.570459 19645 consensus_queue.cc:260] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 } } peers { permanent_uuid: "812ada6d0f3d42d383b43c54965cf535" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 43191 } } peers { permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 } }
I20260806 11:51:17.570911 19644 consensus_queue.cc:260] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 } } peers { permanent_uuid: "812ada6d0f3d42d383b43c54965cf535" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 43191 } } peers { permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 } }
I20260806 11:51:17.570911 19643 consensus_queue.cc:260] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 } } peers { permanent_uuid: "812ada6d0f3d42d383b43c54965cf535" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 43191 } } peers { permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 } }
I20260806 11:51:17.571563 19239 heartbeater.cc:503] Master 127.26.172.254:41153 was elected leader, sending a full tablet report...
I20260806 11:51:17.572207 19643 ts_tablet_manager.cc:1428] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 11:51:17.572218 19644 ts_tablet_manager.cc:1428] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20260806 11:51:17.572701 19432 heartbeater.cc:503] Master 127.26.172.254:41153 was elected leader, sending a full tablet report...
I20260806 11:51:17.573153 19618 heartbeater.cc:503] Master 127.26.172.254:41153 was elected leader, sending a full tablet report...
I20260806 11:51:17.575042 19645 ts_tablet_manager.cc:1428] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
W20260806 11:51:17.735514 19619 tablet.cc:2369] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:51:17.738991 19240 tablet.cc:2369] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:51:17.745823 19433 tablet.cc:2369] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:51:17.773087 19651 raft_consensus.cc:482] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:17.773484 19651 raft_consensus.cc:504] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 } } peers { permanent_uuid: "812ada6d0f3d42d383b43c54965cf535" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 43191 } } peers { permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 } }
I20260806 11:51:17.775417 19651 leader_election.cc:288] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ade2862b0f74fab93c5c86bacc85f41 (127.26.172.193:44137), a789fefc9d29498081cf531b228b00c9 (127.26.172.194:36741)
I20260806 11:51:17.780128 19637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.776054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:50679 (local address 127.26.172.193:44137)
0806 11:51:17.776254 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:17.776261 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:17.776283 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:51:17.776360 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:17.776364 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:17.776417 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:17.776499 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:17.776986 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.777791 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.779019 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.779455 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.779607 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.779673 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:17.779870 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 11:51:17.779955 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 11:51:17.780128 19620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.775819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:44137 (local address 127.26.172.195:50679)
0806 11:51:17.776029 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:17.776048 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:17.776227 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:17.776623 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:17.776628 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:17.776664 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:17.776829 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.776841 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.777912 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.777916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.778808 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.778855 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.779611 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.779615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.779733 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.779755 (+ 22us) client_negotiation.cc:769] Sending connection context
0806 11:51:17.779850 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 11:51:17.779950 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 11:51:17.780721 19642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.776356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:43891 (local address 127.26.172.194:36741)
0806 11:51:17.776513 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:17.776518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:17.776844 (+ 326us) server_negotiation.cc:407] Connection header received
0806 11:51:17.777060 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:17.777066 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:17.777148 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:17.777236 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:17.777672 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.778317 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.779575 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.779997 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.780138 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.780199 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:17.780447 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 11:51:17.780530 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 11:51:17.781175 19653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.776188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:36741 (local address 127.26.172.195:43891)
0806 11:51:17.776727 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:17.776744 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:17.776933 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:17.777285 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:17.777288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:17.777313 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:17.777517 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.777524 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.778451 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.778457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.779430 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:17.779441 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.780151 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.780155 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:17.780271 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.780301 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 11:51:17.780922 (+ 621us) client_negotiation.cc:240] Negotiation successful
0806 11:51:17.781013 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":181,"threads_started":1}
I20260806 11:51:17.781131 19176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d82edf0411141409428f2efb3770340" candidate_uuid: "812ada6d0f3d42d383b43c54965cf535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ade2862b0f74fab93c5c86bacc85f41" is_pre_election: true
I20260806 11:51:17.781544 19176 raft_consensus.cc:2454] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812ada6d0f3d42d383b43c54965cf535 in term 0.
I20260806 11:51:17.782127 19464 leader_election.cc:302] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ade2862b0f74fab93c5c86bacc85f41, 812ada6d0f3d42d383b43c54965cf535; no voters:
I20260806 11:51:17.782137 19365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d82edf0411141409428f2efb3770340" candidate_uuid: "812ada6d0f3d42d383b43c54965cf535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a789fefc9d29498081cf531b228b00c9" is_pre_election: true
I20260806 11:51:17.782456 19651 raft_consensus.cc:2781] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:51:17.782567 19651 raft_consensus.cc:482] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:51:17.782536 19365 raft_consensus.cc:2454] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 812ada6d0f3d42d383b43c54965cf535 in term 0.
I20260806 11:51:17.782603 19651 raft_consensus.cc:3037] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:17.783975 19651 raft_consensus.cc:504] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 } } peers { permanent_uuid: "812ada6d0f3d42d383b43c54965cf535" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 43191 } } peers { permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 } }
I20260806 11:51:17.784415 19651 leader_election.cc:288] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [CANDIDATE]: Term 1 election: Requested vote from peers 7ade2862b0f74fab93c5c86bacc85f41 (127.26.172.193:44137), a789fefc9d29498081cf531b228b00c9 (127.26.172.194:36741)
I20260806 11:51:17.784897 19176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d82edf0411141409428f2efb3770340" candidate_uuid: "812ada6d0f3d42d383b43c54965cf535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ade2862b0f74fab93c5c86bacc85f41"
I20260806 11:51:17.784891 19365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d82edf0411141409428f2efb3770340" candidate_uuid: "812ada6d0f3d42d383b43c54965cf535" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a789fefc9d29498081cf531b228b00c9"
I20260806 11:51:17.785020 19176 raft_consensus.cc:3037] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:17.785073 19365 raft_consensus.cc:3037] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:17.786276 19176 raft_consensus.cc:2454] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812ada6d0f3d42d383b43c54965cf535 in term 1.
I20260806 11:51:17.786672 19464 leader_election.cc:302] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ade2862b0f74fab93c5c86bacc85f41, 812ada6d0f3d42d383b43c54965cf535; no voters:
I20260806 11:51:17.786700 19365 raft_consensus.cc:2454] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 812ada6d0f3d42d383b43c54965cf535 in term 1.
I20260806 11:51:17.786944 19651 raft_consensus.cc:2781] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:17.787284 19651 raft_consensus.cc:686] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 1 LEADER]: Becoming Leader. State: Replica: 812ada6d0f3d42d383b43c54965cf535, State: Running, Role: LEADER
I20260806 11:51:17.787694 19651 consensus_queue.cc:237] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 } } peers { permanent_uuid: "812ada6d0f3d42d383b43c54965cf535" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 43191 } } peers { permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 } }
I20260806 11:51:17.791322 18958 catalog_manager.cc:5495] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 reported cstate change: term changed from 0 to 1, leader changed from <none> to 812ada6d0f3d42d383b43c54965cf535 (127.26.172.195). New cstate: current_term: 1 leader_uuid: "812ada6d0f3d42d383b43c54965cf535" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "812ada6d0f3d42d383b43c54965cf535" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 43191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 } health_report { overall_health: UNKNOWN } } }
I20260806 11:51:17.847906 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.842661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43772 (local address 127.26.172.195:43191)
0806 11:51:17.842898 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:17.842904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:17.842927 (+ 23us) server_negotiation.cc:407] Connection header received
0806 11:51:17.843137 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:17.843141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:17.843221 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:17.843386 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:51:17.843738 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.844365 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.845393 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:17.845729 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:17.845859 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:17.846441 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:51:17.847339 (+ 898us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:51:17.847499 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:17.847571 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 11:51:17.847645 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 11:51:17.856616 19176 raft_consensus.cc:1261] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41 [term 1 FOLLOWER]: Refusing update from remote peer 812ada6d0f3d42d383b43c54965cf535: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:17.856616 19365 raft_consensus.cc:1261] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9 [term 1 FOLLOWER]: Refusing update from remote peer 812ada6d0f3d42d383b43c54965cf535: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:17.857703 19651 consensus_queue.cc:1035] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a789fefc9d29498081cf531b228b00c9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 36741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:17.857987 19656 consensus_queue.cc:1035] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ade2862b0f74fab93c5c86bacc85f41" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 44137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:17.872790 19661 mvcc.cc:205] Tried to move back new op lower bound from 7315525950889439232 to 7315525950621196288. Current Snapshot: MvccSnapshot[applied={T|T < 7315525950889439232}]
I20260806 11:51:17.873273 19660 mvcc.cc:205] Tried to move back new op lower bound from 7315525950889439232 to 7315525950621196288. Current Snapshot: MvccSnapshot[applied={T|T < 7315525950889439232}]
I20260806 11:51:17.882160 18962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:17.882382 18962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:17.885936 18962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf3a107eba964f2d8b899527dbb8783d: Sending DeleteTablet for 3 replicas of tablet 4d82edf0411141409428f2efb3770340
I20260806 11:51:17.887146 19526 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d82edf0411141409428f2efb3770340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:17 UTC) from {username='slave'} at 127.0.0.1:43762
I20260806 11:51:17.887142 19152 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d82edf0411141409428f2efb3770340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:17 UTC) from {username='slave'} at 127.0.0.1:50192
I20260806 11:51:17.887821 19334 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d82edf0411141409428f2efb3770340 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:17 UTC) from {username='slave'} at 127.0.0.1:56468
I20260806 11:51:17.887910 19673 tablet_replica.cc:330] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41: stopping tablet replica
I20260806 11:51:17.888355 19675 tablet_replica.cc:330] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: stopping tablet replica
I20260806 11:51:17.888687 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 19056
I20260806 11:51:17.888669 19673 raft_consensus.cc:2229] T 4d82edf0411141409428f2efb3770340 P 7ade2862b0f74fab93c5c86bacc85f41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:17.891605 19671 tablet_replica.cc:330] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: stopping tablet replica
I20260806 11:51:17.892141 19671 raft_consensus.cc:2229] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:51:17.892184 19675 raft_consensus.cc:2229] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:17.892728 19675 raft_consensus.cc:2258] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:17.892882 19671 raft_consensus.cc:2258] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:17.895833 19675 ts_tablet_manager.cc:1905] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:17.895870 19671 ts_tablet_manager.cc:1905] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:17.899766 19671 ts_tablet_manager.cc:1918] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:17.899937 19675 ts_tablet_manager.cc:1918] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:17.900100 19671 log.cc:1196] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/4d82edf0411141409428f2efb3770340
I20260806 11:51:17.900099 19675 log.cc:1196] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/4d82edf0411141409428f2efb3770340
I20260806 11:51:17.900517 19675 ts_tablet_manager.cc:1939] T 4d82edf0411141409428f2efb3770340 P a789fefc9d29498081cf531b228b00c9: Deleting consensus metadata
I20260806 11:51:17.900802 19671 ts_tablet_manager.cc:1939] T 4d82edf0411141409428f2efb3770340 P 812ada6d0f3d42d383b43c54965cf535: Deleting consensus metadata
I20260806 11:51:17.902866 18946 catalog_manager.cc:4841] TS a789fefc9d29498081cf531b228b00c9 (127.26.172.194:36741): tablet 4d82edf0411141409428f2efb3770340 (table test-table [id=ce19ec1fa218471a952cf7f7bd50d584]) successfully deleted
W20260806 11:51:17.903590 18946 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:44137 (error 108)
I20260806 11:51:17.903795 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 19244
I20260806 11:51:17.904170 18946 catalog_manager.cc:4841] TS 812ada6d0f3d42d383b43c54965cf535 (127.26.172.195:43191): tablet 4d82edf0411141409428f2efb3770340 (table test-table [id=ce19ec1fa218471a952cf7f7bd50d584]) successfully deleted
I20260806 11:51:17.910748 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:17.910154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:44137 (local address 127.0.0.1:50200)
0806 11:51:17.910495 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:17.910599 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:44137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215}
W20260806 11:51:17.911052 18946 catalog_manager.cc:4584] TS 7ade2862b0f74fab93c5c86bacc85f41 (127.26.172.193:44137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4d82edf0411141409428f2efb3770340: Network error: Client connection negotiation failed: client connection to 127.26.172.193:44137: connect: Connection refused (error 111)
I20260806 11:51:17.919499 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 19436
I20260806 11:51:17.932719 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 18923
2026-08-06T11:51:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1510 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:18 dist-test-slave-7z32 krb5kdc[19680](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:18 dist-test-slave-7z32 krb5kdc[19680](info): set up 2 sockets
Aug 06 11:51:18 dist-test-slave-7z32 krb5kdc[19680](info): commencing operation
krb5kdc: starting...
W20260806 11:51:19.205940 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.005s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:19 dist-test-slave-7z32 krb5kdc[19680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:51:19.375209 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:39371
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:38293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:39371
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:19.505182 19699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:19.505522 19699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:19.505568 19699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:19.509896 19699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:19.510017 19699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:19.510039 19699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:19.510057 19699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:19.510074 19699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:19.515974 19699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:39371
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:39371
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:19.517257 19699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:19.518455 19699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:19.528507 19709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:19.528565 19706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:19.528565 19707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:19.528988 19699 server_base.cc:1034] running on GCE node
I20260806 11:51:19.529700 19699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:19.531052 19699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:19.532380 19699 hybrid_clock.cc:648] HybridClock initialized: now 1786017079532357 us; error 49 us; skew 500 ppm
Aug 06 11:51:19 dist-test-slave-7z32 krb5kdc[19680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017079, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:19.543179 19699 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:51:19.544528 19699 webserver.cc:460] Webserver started at http://127.26.172.254:34081/ using document root <none> and password file <none>
I20260806 11:51:19.545230 19699 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:19.545347 19699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:19.545630 19699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:19.548151 19699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "45a6d8b856c84f4e9406afc087c2e69c"
format_stamp: "Formatted at 2026-08-06 11:51:19 on dist-test-slave-7z32"
server_key: "82272d79e4f977844a92cc89ec7fd5a5"
server_key_iv: "43453b033b2491cf0a5d33b0fb07aef8"
server_key_version: "encryptionkey@0"
I20260806 11:51:19.548784 19699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "45a6d8b856c84f4e9406afc087c2e69c"
format_stamp: "Formatted at 2026-08-06 11:51:19 on dist-test-slave-7z32"
server_key: "82272d79e4f977844a92cc89ec7fd5a5"
server_key_iv: "43453b033b2491cf0a5d33b0fb07aef8"
server_key_version: "encryptionkey@0"
I20260806 11:51:19.553557 19699 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 11:51:19.556906 19719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:19.558772 19699 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 11:51:19.559072 19699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "45a6d8b856c84f4e9406afc087c2e69c"
format_stamp: "Formatted at 2026-08-06 11:51:19 on dist-test-slave-7z32"
server_key: "82272d79e4f977844a92cc89ec7fd5a5"
server_key_iv: "43453b033b2491cf0a5d33b0fb07aef8"
server_key_version: "encryptionkey@0"
I20260806 11:51:19.559239 19699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:19.584760 19699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:19.589000 19699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:19.589277 19699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:19.598678 19699 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:39371
I20260806 11:51:19.598713 19796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:39371 every 8 connection(s)
I20260806 11:51:19.599892 19699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:19.603897 19799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:19.606945 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 19699
I20260806 11:51:19.607142 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:19.607523 27315 external_mini_cluster.cc:1428] Setting key a80d0753ced35dae60b8e6a3c655ff8f
I20260806 11:51:19.612838 19799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c: Bootstrap starting.
I20260806 11:51:19.616381 19799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:19.617543 19799 log.cc:824] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c: Log is configured to *not* fsync() on all Append() calls
Aug 06 11:51:19 dist-test-slave-7z32 krb5kdc[19680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:19.620712 19799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c: No bootstrap required, opened a new log
I20260806 11:51:19.625615 19802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:19.609562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35178 (local address 127.26.172.254:39371)
0806 11:51:19.610137 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:19.610155 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:19.610200 (+ 45us) server_negotiation.cc:407] Connection header received
0806 11:51:19.611404 (+ 1204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:19.611428 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:19.611841 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:19.612204 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:19.613475 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:19.614612 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:19.615957 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:19.616544 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:19.616745 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:19.620179 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:19.620186 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:19.620206 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:19.620240 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:19.622296 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:19.622870 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:19.622885 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:19.622893 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:19.623037 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:19.623352 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:19.623355 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:19.623357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:19.623837 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:19.624091 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:19.624382 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 11:51:19.624728 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":183,"threads_started":1}
I20260806 11:51:19.625519 19799 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a6d8b856c84f4e9406afc087c2e69c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39371 } }
I20260806 11:51:19.625885 19799 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:19.625937 19799 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45a6d8b856c84f4e9406afc087c2e69c, State: Initialized, Role: FOLLOWER
I20260806 11:51:19.626549 19799 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a6d8b856c84f4e9406afc087c2e69c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39371 } }
I20260806 11:51:19.626691 19799 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:19.626739 19799 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:19.626873 19799 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:19.628288 19799 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a6d8b856c84f4e9406afc087c2e69c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39371 } }
I20260806 11:51:19.628756 19799 leader_election.cc:302] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45a6d8b856c84f4e9406afc087c2e69c; no voters:
I20260806 11:51:19.629200 19799 leader_election.cc:288] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:19.629518 19805 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:19.629873 19805 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [term 1 LEADER]: Becoming Leader. State: Replica: 45a6d8b856c84f4e9406afc087c2e69c, State: Running, Role: LEADER
I20260806 11:51:19.630246 19805 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a6d8b856c84f4e9406afc087c2e69c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39371 } }
I20260806 11:51:19.631059 19799 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:19.632537 19807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45a6d8b856c84f4e9406afc087c2e69c. Latest consensus state: current_term: 1 leader_uuid: "45a6d8b856c84f4e9406afc087c2e69c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a6d8b856c84f4e9406afc087c2e69c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39371 } } }
I20260806 11:51:19.632717 19807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:19.633062 19806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45a6d8b856c84f4e9406afc087c2e69c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45a6d8b856c84f4e9406afc087c2e69c" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 39371 } } }
I20260806 11:51:19.633211 19806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:19.633327 19817 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:19.637202 19817 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:19.644852 19817 catalog_manager.cc:1347] Generated new cluster ID: 86977698e7e1406ba068b3b0e692d31e
I20260806 11:51:19.644989 19817 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:19.679248 19817 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:19.680943 19817 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:19.688681 19817 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c: Generated new TSK 0
I20260806 11:51:19.689781 19817 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:51:19.735831 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39371
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:38293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:19.860903 19830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:19.861225 19830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:19.861272 19830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:19.865694 19830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:19.865779 19830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:19.865844 19830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:51:19.871472 19830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:19.872649 19830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:19.873809 19830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:19.884974 19839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:19.884912 19843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:19.884902 19838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:19.885260 19830 server_base.cc:1034] running on GCE node
I20260806 11:51:19.885952 19830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:19.886940 19830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:19.888214 19830 hybrid_clock.cc:648] HybridClock initialized: now 1786017079888183 us; error 79 us; skew 500 ppm
Aug 06 11:51:19 dist-test-slave-7z32 krb5kdc[19680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017079, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:19.892405 19830 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:51:19.893782 19830 webserver.cc:460] Webserver started at http://127.26.172.193:33497/ using document root <none> and password file <none>
I20260806 11:51:19.894605 19830 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:19.894730 19830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:19.895100 19830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:19.898002 19830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "170352d0528b4a61999a38c472a113cf"
format_stamp: "Formatted at 2026-08-06 11:51:19 on dist-test-slave-7z32"
server_key: "42317c8b9275d19717d404c479089fde"
server_key_iv: "f7bb12f4811468efcf057e34ba6ce57d"
server_key_version: "encryptionkey@0"
I20260806 11:51:19.898789 19830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "170352d0528b4a61999a38c472a113cf"
format_stamp: "Formatted at 2026-08-06 11:51:19 on dist-test-slave-7z32"
server_key: "42317c8b9275d19717d404c479089fde"
server_key_iv: "f7bb12f4811468efcf057e34ba6ce57d"
server_key_version: "encryptionkey@0"
I20260806 11:51:19.904219 19830 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:51:19.907856 19851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:19.909730 19830 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:19.909958 19830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "170352d0528b4a61999a38c472a113cf"
format_stamp: "Formatted at 2026-08-06 11:51:19 on dist-test-slave-7z32"
server_key: "42317c8b9275d19717d404c479089fde"
server_key_iv: "f7bb12f4811468efcf057e34ba6ce57d"
server_key_version: "encryptionkey@0"
I20260806 11:51:19.910137 19830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:19.928607 19830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:19.933051 19830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:19.933352 19830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:19.934223 19830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:19.935468 19830 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:19.935549 19830 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:19.935629 19830 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:19.935678 19830 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:19.949150 19830 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:39133
I20260806 11:51:19.949227 20018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:39133 every 8 connection(s)
I20260806 11:51:19.950443 19830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:51:19.955469 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 19830
I20260806 11:51:19.955616 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:51:19.955998 27315 external_mini_cluster.cc:1428] Setting key 681b56a1b85ffbbd3dfe2eee5322b5f4
Aug 06 11:51:19 dist-test-slave-7z32 krb5kdc[19680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017079, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:19.968065 19802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:19.953016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:56153 (local address 127.26.172.254:39371)
0806 11:51:19.953232 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:19.953237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:19.954388 (+ 1151us) server_negotiation.cc:407] Connection header received
0806 11:51:19.956139 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:19.956143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:19.956207 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:19.956314 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:19.957953 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:19.958522 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:19.959840 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:19.960086 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:19.960206 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:19.963504 (+ 3298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:19.963508 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:19.963510 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:19.963536 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:19.965553 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:19.966228 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:19.966232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:19.966233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:19.966326 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:19.966735 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:19.966738 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:19.966740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:19.967038 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:19.967155 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:19.967728 (+ 573us) server_negotiation.cc:299] Negotiation successful
0806 11:51:19.967882 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 11:51:19.969050 20022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:19.953532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:39371 (local address 127.26.172.193:56153)
0806 11:51:19.954168 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:19.954224 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:19.955874 (+ 1650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:19.956537 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:19.956546 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:19.957073 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:19.957781 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:19.957799 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:19.958666 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:19.958677 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:19.959690 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:19.959700 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:19.960267 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:19.960272 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:19.960451 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:19.961143 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:51:19.961160 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:19.963281 (+ 2121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:19.965702 (+ 2421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:19.965710 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:19.965731 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:19.966085 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:19.966432 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:19.966435 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:19.966438 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:19.966620 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:19.967156 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:19.967165 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:19.967459 (+ 294us) client_negotiation.cc:769] Sending connection context
0806 11:51:19.967665 (+ 206us) client_negotiation.cc:240] Negotiation successful
0806 11:51:19.968054 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":170,"threads_started":1}
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:51:19.970508 20019 heartbeater.cc:347] Connected to a master server at 127.26.172.254:39371
I20260806 11:51:19.970906 20019 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:19.971519 20019 heartbeater.cc:511] Master 127.26.172.254:39371 requested a full tablet report, sending...
I20260806 11:51:19.973292 19743 ts_manager.cc:194] Registered new tserver with Master: 170352d0528b4a61999a38c472a113cf (127.26.172.193:39133)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:51:19.975024 19743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:56153
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:51:19.995260 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39371
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:38293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:20.144223 20025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:20.144706 20025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:20.144793 20025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:20.149683 20025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:20.149828 20025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:20.149940 20025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:51:20.156976 20025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:20.158814 20025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:20.160364 20025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 11:51:20.174226 20025 server_base.cc:1034] running on GCE node
W20260806 11:51:20.174000 20034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:20.174005 20033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:20.174021 20038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:20.175218 20025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:20.176091 20025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:20.177323 20025 hybrid_clock.cc:648] HybridClock initialized: now 1786017080177295 us; error 49 us; skew 500 ppm
Aug 06 11:51:20 dist-test-slave-7z32 krb5kdc[19680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017080, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:20.181180 20025 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:51:20.182363 20025 webserver.cc:460] Webserver started at http://127.26.172.194:44761/ using document root <none> and password file <none>
I20260806 11:51:20.183207 20025 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:20.183317 20025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:20.183605 20025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:20.186049 20025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "43982ff98e094d2bb81ab6edabe2b78d"
format_stamp: "Formatted at 2026-08-06 11:51:20 on dist-test-slave-7z32"
server_key: "a06a6d19db21823c7ae31bd7a568bea5"
server_key_iv: "5c662609bf7a686f93f4d34dbd78787b"
server_key_version: "encryptionkey@0"
I20260806 11:51:20.186748 20025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "43982ff98e094d2bb81ab6edabe2b78d"
format_stamp: "Formatted at 2026-08-06 11:51:20 on dist-test-slave-7z32"
server_key: "a06a6d19db21823c7ae31bd7a568bea5"
server_key_iv: "5c662609bf7a686f93f4d34dbd78787b"
server_key_version: "encryptionkey@0"
I20260806 11:51:20.192024 20025 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260806 11:51:20.195447 20048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:20.197206 20025 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:20.197427 20025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "43982ff98e094d2bb81ab6edabe2b78d"
format_stamp: "Formatted at 2026-08-06 11:51:20 on dist-test-slave-7z32"
server_key: "a06a6d19db21823c7ae31bd7a568bea5"
server_key_iv: "5c662609bf7a686f93f4d34dbd78787b"
server_key_version: "encryptionkey@0"
I20260806 11:51:20.197579 20025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:20.209924 20025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:20.213863 20025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:20.214216 20025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:20.215091 20025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:20.216213 20025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:20.216301 20025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:20.216395 20025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:20.216450 20025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:20.227341 20025 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:46855
I20260806 11:51:20.227391 20215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:46855 every 8 connection(s)
I20260806 11:51:20.228557 20025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:51:20.237418 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 20025
I20260806 11:51:20.237572 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:51:20.237928 27315 external_mini_cluster.cc:1428] Setting key 8a404733f10ba81650c931fd8f42948f
Aug 06 11:51:20 dist-test-slave-7z32 krb5kdc[19680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017080, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:20.247828 19802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.231420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:56649 (local address 127.26.172.254:39371)
0806 11:51:20.231602 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:20.231607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:20.232821 (+ 1214us) server_negotiation.cc:407] Connection header received
0806 11:51:20.234681 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:20.234686 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:20.234773 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:20.234889 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:20.236457 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.237105 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.238791 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.239122 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.239222 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.243011 (+ 3789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:20.243014 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:20.243017 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:20.243072 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:20.244847 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:20.245549 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:20.245554 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:20.245556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:20.245653 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:20.246093 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:20.246097 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:20.246099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:20.246339 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:20.246459 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:20.247462 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0806 11:51:20.247675 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 11:51:20.249413 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.231888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:39371 (local address 127.26.172.194:56649)
0806 11:51:20.232578 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:20.232638 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:20.234392 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:20.235132 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:20.235141 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:20.235630 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:20.236283 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.236300 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.237352 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.237357 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.238609 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.238629 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.239321 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.239325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.239551 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.240334 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:51:20.240358 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:20.242710 (+ 2352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:20.245017 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:20.245026 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:20.245057 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:20.245425 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:20.245799 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:20.245803 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:20.245805 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:20.245980 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:20.246460 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:20.246471 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:20.246999 (+ 528us) client_negotiation.cc:769] Sending connection context
0806 11:51:20.247303 (+ 304us) client_negotiation.cc:240] Negotiation successful
0806 11:51:20.247863 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":142,"threads_started":1}
I20260806 11:51:20.251187 20216 heartbeater.cc:347] Connected to a master server at 127.26.172.254:39371
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:51:20.251577 20216 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:20.252291 20216 heartbeater.cc:511] Master 127.26.172.254:39371 requested a full tablet report, sending...
I20260806 11:51:20.253928 19743 ts_manager.cc:194] Registered new tserver with Master: 43982ff98e094d2bb81ab6edabe2b78d (127.26.172.194:46855)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:51:20.254729 19743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:56649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:51:20.275712 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39371
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:38293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:20.423121 20223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:20.423516 20223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:20.423568 20223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:20.428139 20223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:20.428237 20223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:20.428331 20223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:51:20.435039 20223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:38293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:39371
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:20.436513 20223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:20.437793 20223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:20.449929 20232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:20.450042 20236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:20.449946 20230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:20.450263 20223 server_base.cc:1034] running on GCE node
I20260806 11:51:20.451032 20223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:20.451848 20223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:20.453068 20223 hybrid_clock.cc:648] HybridClock initialized: now 1786017080453050 us; error 40 us; skew 500 ppm
Aug 06 11:51:20 dist-test-slave-7z32 krb5kdc[19680](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017080, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:20.456384 20223 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:51:20.457440 20223 webserver.cc:460] Webserver started at http://127.26.172.195:33567/ using document root <none> and password file <none>
I20260806 11:51:20.458137 20223 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:20.458240 20223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:20.458545 20223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:20.460932 20223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "83747dc8403d4e4bbd2f3b640fb18f91"
format_stamp: "Formatted at 2026-08-06 11:51:20 on dist-test-slave-7z32"
server_key: "b8186ccba21c91b0d6b627ef4a2d5db5"
server_key_iv: "7509ff50ce35323a4e67894a22db2980"
server_key_version: "encryptionkey@0"
I20260806 11:51:20.461573 20223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "83747dc8403d4e4bbd2f3b640fb18f91"
format_stamp: "Formatted at 2026-08-06 11:51:20 on dist-test-slave-7z32"
server_key: "b8186ccba21c91b0d6b627ef4a2d5db5"
server_key_iv: "7509ff50ce35323a4e67894a22db2980"
server_key_version: "encryptionkey@0"
I20260806 11:51:20.466359 20223 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260806 11:51:20.469378 20245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:20.471299 20223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 11:51:20.471527 20223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "83747dc8403d4e4bbd2f3b640fb18f91"
format_stamp: "Formatted at 2026-08-06 11:51:20 on dist-test-slave-7z32"
server_key: "b8186ccba21c91b0d6b627ef4a2d5db5"
server_key_iv: "7509ff50ce35323a4e67894a22db2980"
server_key_version: "encryptionkey@0"
I20260806 11:51:20.471674 20223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:20.507870 20223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:20.511677 20223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:20.511926 20223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:20.512629 20223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:20.513618 20223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:20.513696 20223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:20.513770 20223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:20.513816 20223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:20.525449 20223 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:38851
I20260806 11:51:20.525542 20406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:38851 every 8 connection(s)
I20260806 11:51:20.526762 20223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:51:20.527094 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 20223
I20260806 11:51:20.527273 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:51:20.527717 27315 external_mini_cluster.cc:1428] Setting key 923246e18836bb9afc9c0dc56007779f
Aug 06 11:51:20 dist-test-slave-7z32 krb5kdc[19680](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017080, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:20.544591 19802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.529746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:40767 (local address 127.26.172.254:39371)
0806 11:51:20.529936 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:20.529942 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:20.531368 (+ 1426us) server_negotiation.cc:407] Connection header received
0806 11:51:20.533041 (+ 1673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:20.533044 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:20.533102 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:20.533183 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:20.534571 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.535219 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.536409 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.536651 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.536769 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.540010 (+ 3241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:20.540013 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:20.540016 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:20.540047 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:20.541655 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:20.542248 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:20.542252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:20.542254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:20.542381 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:20.543095 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:20.543099 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:20.543103 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:20.543347 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:20.543507 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:20.544302 (+ 795us) server_negotiation.cc:299] Negotiation successful
0806 11:51:20.544450 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 11:51:20.545845 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.530371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:39371 (local address 127.26.172.195:40767)
0806 11:51:20.531189 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:20.531250 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:20.532804 (+ 1554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:20.533378 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:20.533387 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:20.533866 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:20.534403 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.534428 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.535352 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.535356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.536267 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.536277 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.536838 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.536843 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.537035 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.537731 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:51:20.537747 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:20.539738 (+ 1991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:20.541791 (+ 2053us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:20.541799 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:20.541822 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:20.542128 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:20.542523 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:20.542526 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:20.542528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:20.542970 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:20.543532 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:20.543543 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:20.543985 (+ 442us) client_negotiation.cc:769] Sending connection context
0806 11:51:20.544197 (+ 212us) client_negotiation.cc:240] Negotiation successful
0806 11:51:20.544617 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":230,"threads_started":1}
I20260806 11:51:20.547475 20407 heartbeater.cc:347] Connected to a master server at 127.26.172.254:39371
I20260806 11:51:20.547817 20407 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:20.548491 20407 heartbeater.cc:511] Master 127.26.172.254:39371 requested a full tablet report, sending...
I20260806 11:51:20.549950 19743 ts_manager.cc:194] Registered new tserver with Master: 83747dc8403d4e4bbd2f3b640fb18f91 (127.26.172.195:38851)
I20260806 11:51:20.550717 19743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:40767
I20260806 11:51:20.556306 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:51:20.568900 19802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.558994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35182 (local address 127.26.172.254:39371)
0806 11:51:20.559232 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:20.559237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:20.559390 (+ 153us) server_negotiation.cc:407] Connection header received
0806 11:51:20.559640 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:20.559645 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:20.559701 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:20.559811 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:20.560657 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.561251 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.562151 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.562391 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.562506 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.564459 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:20.564464 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:20.564467 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:20.564495 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:20.566275 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:20.567038 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:20.567043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:20.567045 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:20.567155 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:20.567689 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:20.567693 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:20.567695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:20.567986 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:20.568193 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:20.568525 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 11:51:20.568677 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260806 11:51:20.573487 19743 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:51:20.577112 19743 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:51:20.595391 20423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.587602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:38851 (local address 127.0.0.1:59798)
0806 11:51:20.588557 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:20.588611 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:20.588769 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:20.590057 (+ 1288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:20.590059 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:20.590072 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:20.590192 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.590197 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.592215 (+ 2018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.592218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.593459 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.593471 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.594933 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.594939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.595038 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.595064 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 11:51:20.595149 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 11:51:20.595216 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"mutex_wait_us":127,"thread_start_us":113,"threads_started":1}
I20260806 11:51:20.595741 20424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.587839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59798 (local address 127.26.172.195:38851)
0806 11:51:20.589403 (+ 1564us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:20.589419 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:20.589445 (+ 26us) server_negotiation.cc:407] Connection header received
0806 11:51:20.589550 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:20.589555 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:20.589828 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:20.590070 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:20.590995 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.592045 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.593613 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.594577 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.594713 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.594908 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:20.595409 (+ 501us) server_negotiation.cc:299] Negotiation successful
0806 11:51:20.595539 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1445,"thread_start_us":131,"threads_started":1}
I20260806 11:51:20.595780 20427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.588492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38992 (local address 127.26.172.194:46855)
0806 11:51:20.589047 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:20.589063 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:20.589096 (+ 33us) server_negotiation.cc:407] Connection header received
0806 11:51:20.589343 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:20.589351 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:20.589604 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:20.589782 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:20.590224 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.591600 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.593792 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.594479 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.594634 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.594821 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:20.595472 (+ 651us) server_negotiation.cc:299] Negotiation successful
0806 11:51:20.595620 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":143,"threads_started":1}
I20260806 11:51:20.595391 20426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.587795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:46855 (local address 127.0.0.1:38992)
0806 11:51:20.589006 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:20.589022 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:20.589108 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:20.589807 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:20.589815 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:20.589846 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:20.590062 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.590073 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.591777 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.591781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.593647 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.593656 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.594626 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.594630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.594757 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.594804 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 11:51:20.594975 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 11:51:20.595171 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1145,"mutex_wait_us":561,"thread_start_us":183,"threads_started":1}
I20260806 11:51:20.596591 20429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.588564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56848 (local address 127.26.172.193:39133)
0806 11:51:20.589103 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:20.589112 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:20.589437 (+ 325us) server_negotiation.cc:407] Connection header received
0806 11:51:20.589516 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:20.589521 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:20.589667 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:20.589788 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:20.590342 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.591600 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.593679 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.594577 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.594713 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.594908 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:20.596323 (+ 1415us) server_negotiation.cc:299] Negotiation successful
0806 11:51:20.596451 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":95,"threads_started":1}
I20260806 11:51:20.596992 20425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.587974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:39133 (local address 127.0.0.1:56848)
0806 11:51:20.589247 (+ 1273us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:20.589261 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:20.589348 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:20.589974 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:20.589976 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:20.589994 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:20.590190 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.590197 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.591777 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.591781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.593485 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.593498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.594995 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.594999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.595080 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.595110 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 11:51:20.595217 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 11:51:20.596853 (+ 1636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1212,"mutex_wait_us":59,"thread_start_us":129,"threads_started":1}
I20260806 11:51:20.600173 20311 tablet_service.cc:1467] Processing CreateTablet for tablet ea8cf5f643b142339b3338f20b76a578 (DEFAULT_TABLE table=test-table [id=f30ad79972f6426ebac4a42023171234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:20.600173 20118 tablet_service.cc:1467] Processing CreateTablet for tablet ea8cf5f643b142339b3338f20b76a578 (DEFAULT_TABLE table=test-table [id=f30ad79972f6426ebac4a42023171234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:20.601589 20311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea8cf5f643b142339b3338f20b76a578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:20.601589 20118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea8cf5f643b142339b3338f20b76a578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:20.601261 19923 tablet_service.cc:1467] Processing CreateTablet for tablet ea8cf5f643b142339b3338f20b76a578 (DEFAULT_TABLE table=test-table [id=f30ad79972f6426ebac4a42023171234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:20.602909 19923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ea8cf5f643b142339b3338f20b76a578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:20.612206 20432 tablet_bootstrap.cc:492] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: Bootstrap starting.
I20260806 11:51:20.613631 20433 tablet_bootstrap.cc:492] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf: Bootstrap starting.
I20260806 11:51:20.615420 20432 tablet_bootstrap.cc:654] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:20.615420 20430 tablet_bootstrap.cc:492] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: Bootstrap starting.
I20260806 11:51:20.616703 20433 tablet_bootstrap.cc:654] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:20.617254 20432 log.cc:824] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:20.617590 20433 log.cc:824] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:20.618896 20430 tablet_bootstrap.cc:654] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:20.620110 20433 tablet_bootstrap.cc:492] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf: No bootstrap required, opened a new log
I20260806 11:51:20.620110 20432 tablet_bootstrap.cc:492] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: No bootstrap required, opened a new log
I20260806 11:51:20.620357 20433 ts_tablet_manager.cc:1397] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 11:51:20.620357 20432 ts_tablet_manager.cc:1397] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260806 11:51:20.620446 20430 log.cc:824] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:20.625102 20433 raft_consensus.cc:348] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 } } peers { permanent_uuid: "43982ff98e094d2bb81ab6edabe2b78d" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 46855 } } peers { permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 } }
I20260806 11:51:20.625051 20432 raft_consensus.cc:348] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 } } peers { permanent_uuid: "43982ff98e094d2bb81ab6edabe2b78d" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 46855 } } peers { permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 } }
I20260806 11:51:20.625428 20432 raft_consensus.cc:374] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:20.625428 20433 raft_consensus.cc:374] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:20.625485 20432 raft_consensus.cc:729] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43982ff98e094d2bb81ab6edabe2b78d, State: Initialized, Role: FOLLOWER
I20260806 11:51:20.625485 20433 raft_consensus.cc:729] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 170352d0528b4a61999a38c472a113cf, State: Initialized, Role: FOLLOWER
I20260806 11:51:20.626088 20433 consensus_queue.cc:260] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 } } peers { permanent_uuid: "43982ff98e094d2bb81ab6edabe2b78d" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 46855 } } peers { permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 } }
I20260806 11:51:20.626088 20432 consensus_queue.cc:260] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 } } peers { permanent_uuid: "43982ff98e094d2bb81ab6edabe2b78d" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 46855 } } peers { permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 } }
I20260806 11:51:20.627379 20433 ts_tablet_manager.cc:1428] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260806 11:51:20.627452 20216 heartbeater.cc:503] Master 127.26.172.254:39371 was elected leader, sending a full tablet report...
I20260806 11:51:20.627539 20019 heartbeater.cc:503] Master 127.26.172.254:39371 was elected leader, sending a full tablet report...
I20260806 11:51:20.627957 20432 ts_tablet_manager.cc:1428] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260806 11:51:20.628602 20430 tablet_bootstrap.cc:492] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: No bootstrap required, opened a new log
I20260806 11:51:20.628907 20430 ts_tablet_manager.cc:1397] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260806 11:51:20.634344 20430 raft_consensus.cc:348] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 } } peers { permanent_uuid: "43982ff98e094d2bb81ab6edabe2b78d" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 46855 } } peers { permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 } }
I20260806 11:51:20.634686 20430 raft_consensus.cc:374] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:20.634724 20430 raft_consensus.cc:729] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83747dc8403d4e4bbd2f3b640fb18f91, State: Initialized, Role: FOLLOWER
I20260806 11:51:20.635562 20430 consensus_queue.cc:260] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 } } peers { permanent_uuid: "43982ff98e094d2bb81ab6edabe2b78d" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 46855 } } peers { permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 } }
I20260806 11:51:20.636585 20407 heartbeater.cc:503] Master 127.26.172.254:39371 was elected leader, sending a full tablet report...
I20260806 11:51:20.636917 20430 ts_tablet_manager.cc:1428] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260806 11:51:20.648236 20438 raft_consensus.cc:482] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:20.648568 20438 raft_consensus.cc:504] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 } } peers { permanent_uuid: "43982ff98e094d2bb81ab6edabe2b78d" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 46855 } } peers { permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 } }
I20260806 11:51:20.650157 20438 leader_election.cc:288] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83747dc8403d4e4bbd2f3b640fb18f91 (127.26.172.195:38851), 170352d0528b4a61999a38c472a113cf (127.26.172.193:39133)
I20260806 11:51:20.655277 20218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.650496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:38851 (local address 127.26.172.194:54521)
0806 11:51:20.650796 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:20.650815 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:20.650972 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:20.651370 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:20.651374 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:20.651398 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:20.651591 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.651611 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.652655 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.652659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.653602 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.653614 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.654621 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.654626 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.654754 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.654790 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 11:51:20.654931 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 11:51:20.655050 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171}
I20260806 11:51:20.655386 20424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.650597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:54521 (local address 127.26.172.195:38851)
0806 11:51:20.650866 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:20.650873 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:20.650907 (+ 34us) server_negotiation.cc:407] Connection header received
0806 11:51:20.651117 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:20.651123 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:20.651200 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:20.651294 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:20.651783 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.652458 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.653874 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.654466 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.654608 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.654675 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:20.655033 (+ 358us) server_negotiation.cc:299] Negotiation successful
0806 11:51:20.655117 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260806 11:51:20.655916 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.650552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:39133 (local address 127.26.172.194:46125)
0806 11:51:20.651097 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:20.651116 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:20.651262 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:20.651637 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:20.651640 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:20.651662 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:20.651904 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.651913 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.652881 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.652884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.654053 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:20.654067 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.655210 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.655213 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:20.655374 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.655406 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 11:51:20.655668 (+ 262us) client_negotiation.cc:240] Negotiation successful
0806 11:51:20.655753 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":1,"thread_start_us":192,"threads_started":1}
I20260806 11:51:20.656077 20429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.650706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:46125 (local address 127.26.172.193:39133)
0806 11:51:20.650855 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:20.650862 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:20.651298 (+ 436us) server_negotiation.cc:407] Connection header received
0806 11:51:20.651385 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:20.651388 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:20.651456 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:20.651571 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:20.652077 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.652723 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.654231 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.654970 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.655087 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.655143 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:20.655762 (+ 619us) server_negotiation.cc:299] Negotiation successful
0806 11:51:20.655933 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 11:51:20.656361 20339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea8cf5f643b142339b3338f20b76a578" candidate_uuid: "43982ff98e094d2bb81ab6edabe2b78d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" is_pre_election: true
I20260806 11:51:20.656741 20339 raft_consensus.cc:2454] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43982ff98e094d2bb81ab6edabe2b78d in term 0.
I20260806 11:51:20.656810 19953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea8cf5f643b142339b3338f20b76a578" candidate_uuid: "43982ff98e094d2bb81ab6edabe2b78d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170352d0528b4a61999a38c472a113cf" is_pre_election: true
I20260806 11:51:20.657200 19953 raft_consensus.cc:2454] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43982ff98e094d2bb81ab6edabe2b78d in term 0.
I20260806 11:51:20.657387 20057 leader_election.cc:302] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43982ff98e094d2bb81ab6edabe2b78d, 83747dc8403d4e4bbd2f3b640fb18f91; no voters:
I20260806 11:51:20.658104 20438 raft_consensus.cc:2781] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:51:20.658221 20438 raft_consensus.cc:482] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:51:20.658293 20438 raft_consensus.cc:3037] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:20.659925 20438 raft_consensus.cc:504] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 } } peers { permanent_uuid: "43982ff98e094d2bb81ab6edabe2b78d" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 46855 } } peers { permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 } }
I20260806 11:51:20.660470 20438 leader_election.cc:288] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [CANDIDATE]: Term 1 election: Requested vote from peers 83747dc8403d4e4bbd2f3b640fb18f91 (127.26.172.195:38851), 170352d0528b4a61999a38c472a113cf (127.26.172.193:39133)
I20260806 11:51:20.661013 19953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea8cf5f643b142339b3338f20b76a578" candidate_uuid: "43982ff98e094d2bb81ab6edabe2b78d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "170352d0528b4a61999a38c472a113cf"
I20260806 11:51:20.661036 20339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ea8cf5f643b142339b3338f20b76a578" candidate_uuid: "43982ff98e094d2bb81ab6edabe2b78d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83747dc8403d4e4bbd2f3b640fb18f91"
I20260806 11:51:20.661217 19953 raft_consensus.cc:3037] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:20.661233 20339 raft_consensus.cc:3037] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:20.662590 19953 raft_consensus.cc:2454] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43982ff98e094d2bb81ab6edabe2b78d in term 1.
I20260806 11:51:20.662672 20339 raft_consensus.cc:2454] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43982ff98e094d2bb81ab6edabe2b78d in term 1.
I20260806 11:51:20.663141 20049 leader_election.cc:302] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 170352d0528b4a61999a38c472a113cf, 43982ff98e094d2bb81ab6edabe2b78d; no voters:
I20260806 11:51:20.663437 20438 raft_consensus.cc:2781] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:20.663757 20438 raft_consensus.cc:686] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 1 LEADER]: Becoming Leader. State: Replica: 43982ff98e094d2bb81ab6edabe2b78d, State: Running, Role: LEADER
I20260806 11:51:20.664261 20438 consensus_queue.cc:237] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 } } peers { permanent_uuid: "43982ff98e094d2bb81ab6edabe2b78d" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 46855 } } peers { permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 } }
I20260806 11:51:20.668463 19741 catalog_manager.cc:5495] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d reported cstate change: term changed from 0 to 1, leader changed from <none> to 43982ff98e094d2bb81ab6edabe2b78d (127.26.172.194). New cstate: current_term: 1 leader_uuid: "43982ff98e094d2bb81ab6edabe2b78d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43982ff98e094d2bb81ab6edabe2b78d" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 46855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 } health_report { overall_health: UNKNOWN } } }
W20260806 11:51:20.702399 20021 tablet.cc:2369] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:51:20.703624 20427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.698783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39002 (local address 127.26.172.194:46855)
0806 11:51:20.699061 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:20.699067 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:20.699087 (+ 20us) server_negotiation.cc:407] Connection header received
0806 11:51:20.699198 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:20.699201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:20.699289 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:20.699454 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:51:20.699772 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.700346 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.701312 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:20.701568 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:20.701691 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:20.702167 (+ 476us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:51:20.702930 (+ 763us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:51:20.703108 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:20.703351 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 11:51:20.703412 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260806 11:51:20.711525 20339 raft_consensus.cc:1261] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91 [term 1 FOLLOWER]: Refusing update from remote peer 43982ff98e094d2bb81ab6edabe2b78d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:20.711920 19953 raft_consensus.cc:1261] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf [term 1 FOLLOWER]: Refusing update from remote peer 43982ff98e094d2bb81ab6edabe2b78d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:20.712679 20444 consensus_queue.cc:1035] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [LEADER]: Connected to new peer: Peer: permanent_uuid: "83747dc8403d4e4bbd2f3b640fb18f91" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 38851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:20.712951 20438 consensus_queue.cc:1035] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [LEADER]: Connected to new peer: Peer: permanent_uuid: "170352d0528b4a61999a38c472a113cf" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 39133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:20.724149 20448 mvcc.cc:205] Tried to move back new op lower bound from 7315525962584879104 to 7315525962404290560. Current Snapshot: MvccSnapshot[applied={T|T < 7315525962584879104}]
I20260806 11:51:20.736585 19743 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:20.736969 19743 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:20.740109 19743 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 45a6d8b856c84f4e9406afc087c2e69c: Sending DeleteTablet for 3 replicas of tablet ea8cf5f643b142339b3338f20b76a578
I20260806 11:51:20.741235 20118 tablet_service.cc:1514] Processing DeleteTablet for tablet ea8cf5f643b142339b3338f20b76a578 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:20 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:38992
I20260806 11:51:20.741343 19923 tablet_service.cc:1514] Processing DeleteTablet for tablet ea8cf5f643b142339b3338f20b76a578 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:20 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:56848
I20260806 11:51:20.741397 20311 tablet_service.cc:1514] Processing DeleteTablet for tablet ea8cf5f643b142339b3338f20b76a578 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:20 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:59798
I20260806 11:51:20.742404 20462 tablet_replica.cc:330] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: stopping tablet replica
I20260806 11:51:20.742460 20461 tablet_replica.cc:330] T ea8cf5f643b142339b3338f20b76a578 P 170352d0528b4a61999a38c472a113cf: stopping tablet replica
I20260806 11:51:20.742785 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 19830
I20260806 11:51:20.743077 20462 raft_consensus.cc:2229] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:20.743534 20462 raft_consensus.cc:2258] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:20.745864 20460 tablet_replica.cc:330] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: stopping tablet replica
I20260806 11:51:20.746315 20460 raft_consensus.cc:2229] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:51:20.746927 20460 raft_consensus.cc:2258] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:20.749902 20462 ts_tablet_manager.cc:1905] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:20.753408 20460 ts_tablet_manager.cc:1905] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:20.755527 20462 ts_tablet_manager.cc:1918] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:20.755903 20462 log.cc:1196] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/ea8cf5f643b142339b3338f20b76a578
I20260806 11:51:20.756498 20462 ts_tablet_manager.cc:1939] T ea8cf5f643b142339b3338f20b76a578 P 83747dc8403d4e4bbd2f3b640fb18f91: Deleting consensus metadata
I20260806 11:51:20.757035 20460 ts_tablet_manager.cc:1918] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:20.757184 20460 log.cc:1196] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/ea8cf5f643b142339b3338f20b76a578
I20260806 11:51:20.757566 20460 ts_tablet_manager.cc:1939] T ea8cf5f643b142339b3338f20b76a578 P 43982ff98e094d2bb81ab6edabe2b78d: Deleting consensus metadata
I20260806 11:51:20.758893 19725 catalog_manager.cc:4841] TS 83747dc8403d4e4bbd2f3b640fb18f91 (127.26.172.195:38851): tablet ea8cf5f643b142339b3338f20b76a578 (table test-table [id=f30ad79972f6426ebac4a42023171234]) successfully deleted
I20260806 11:51:20.759552 19722 catalog_manager.cc:4841] TS 43982ff98e094d2bb81ab6edabe2b78d (127.26.172.194:46855): tablet ea8cf5f643b142339b3338f20b76a578 (table test-table [id=f30ad79972f6426ebac4a42023171234]) successfully deleted
W20260806 11:51:20.768592 19721 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:39133 (error 108)
I20260806 11:51:20.769452 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 20025
I20260806 11:51:20.778108 20425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:20.769713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:39133 (local address 127.0.0.1:56850)
0806 11:51:20.777773 (+ 8060us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:20.777918 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:39133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7873}
W20260806 11:51:20.782578 19721 catalog_manager.cc:4584] TS 170352d0528b4a61999a38c472a113cf (127.26.172.193:39133): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ea8cf5f643b142339b3338f20b76a578: Network error: Client connection negotiation failed: client connection to 127.26.172.193:39133: connect: Connection refused (error 111)
I20260806 11:51:20.796299 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 20223
I20260806 11:51:20.809978 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 19699
2026-08-06T11:51:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2871 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T11:51:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:20Z Disabled control of system clock
I20260806 11:51:20.857538 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:41699
--webserver_interface=127.26.172.254
--webserver_port=0
--builtin_ntp_servers=127.26.172.212:34089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:41699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 11:51:20.990726 20467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:20.991093 20467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:20.991132 20467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:20.995465 20467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:20.995560 20467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:20.995576 20467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:20.995594 20467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:20.995610 20467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:21.000851 20467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:34089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:41699
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:41699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:21.002223 20467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:21.003868 20467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:21.014514 20476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:21.014370 20478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:21.014402 20474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:21.015048 20467 server_base.cc:1034] running on GCE node
I20260806 11:51:21.015801 20467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:21.017100 20467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:21.018293 20467 hybrid_clock.cc:648] HybridClock initialized: now 1786017081018243 us; error 83 us; skew 500 ppm
I20260806 11:51:21.020676 20467 webserver.cc:460] Webserver started at http://127.26.172.254:34311/ using document root <none> and password file <none>
I20260806 11:51:21.021382 20467 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:21.021461 20467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:21.021710 20467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:21.024425 20467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "9515db5efed149d6b873f9025d9bbf1b"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "93eb4850a69ba9dde3d5c159bff1714b"
server_key_iv: "c21447d75dbd338b258f16124ca8a74b"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.025146 20467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "9515db5efed149d6b873f9025d9bbf1b"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "93eb4850a69ba9dde3d5c159bff1714b"
server_key_iv: "c21447d75dbd338b258f16124ca8a74b"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.030016 20467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:51:21.033500 20486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:21.035432 20467 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 11:51:21.035634 20467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "9515db5efed149d6b873f9025d9bbf1b"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "93eb4850a69ba9dde3d5c159bff1714b"
server_key_iv: "c21447d75dbd338b258f16124ca8a74b"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.035789 20467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:21.055497 20467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:21.057304 20467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:21.058769 20467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:21.068809 20467 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:41699
I20260806 11:51:21.068838 20558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:41699 every 8 connection(s)
I20260806 11:51:21.070297 20467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:21.074178 20559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:21.078011 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 20467
I20260806 11:51:21.078213 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:21.078649 27315 external_mini_cluster.cc:1428] Setting key b9c1627a8cb183f7c9ffeb7395db5b61
I20260806 11:51:21.080931 20559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b: Bootstrap starting.
I20260806 11:51:21.083532 20559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:21.084383 20559 log.cc:824] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:21.086454 20559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b: No bootstrap required, opened a new log
I20260806 11:51:21.090463 20559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9515db5efed149d6b873f9025d9bbf1b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41699 } }
I20260806 11:51:21.090715 20562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.080509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46310 (local address 127.26.172.254:41699)
0806 11:51:21.081579 (+ 1070us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:21.081608 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:21.081668 (+ 60us) server_negotiation.cc:407] Connection header received
0806 11:51:21.082570 (+ 902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:21.082594 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:21.083230 (+ 636us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:21.083662 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:21.084242 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.085406 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.086434 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.087175 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.087400 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.088479 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:21.088485 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:21.088502 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:21.089014 (+ 512us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:21.089100 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:21.089125 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:21.089257 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:21.089391 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 11:51:21.089734 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":194,"threads_started":1}
I20260806 11:51:21.090760 20559 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:21.090939 20559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9515db5efed149d6b873f9025d9bbf1b, State: Initialized, Role: FOLLOWER
I20260806 11:51:21.091511 20559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9515db5efed149d6b873f9025d9bbf1b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41699 } }
I20260806 11:51:21.091688 20559 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:21.091773 20559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:21.091899 20559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:21.093043 20559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9515db5efed149d6b873f9025d9bbf1b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41699 } }
I20260806 11:51:21.093493 20559 leader_election.cc:302] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9515db5efed149d6b873f9025d9bbf1b; no voters:
I20260806 11:51:21.093909 20559 leader_election.cc:288] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:21.094144 20564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:21.096212 20564 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [term 1 LEADER]: Becoming Leader. State: Replica: 9515db5efed149d6b873f9025d9bbf1b, State: Running, Role: LEADER
I20260806 11:51:21.096704 20564 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9515db5efed149d6b873f9025d9bbf1b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41699 } }
I20260806 11:51:21.097460 20559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:21.098950 20566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9515db5efed149d6b873f9025d9bbf1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9515db5efed149d6b873f9025d9bbf1b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41699 } } }
I20260806 11:51:21.099143 20566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:21.099642 20567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9515db5efed149d6b873f9025d9bbf1b. Latest consensus state: current_term: 1 leader_uuid: "9515db5efed149d6b873f9025d9bbf1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9515db5efed149d6b873f9025d9bbf1b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41699 } } }
I20260806 11:51:21.099771 20567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b [sys.catalog]: This master's current role is: LEADER
W20260806 11:51:21.103560 20582 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:21.103657 20582 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:21.103753 20577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:21.104574 20577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:21.111764 20577 catalog_manager.cc:1347] Generated new cluster ID: 8e133311695b4d468f00224f1d1b2264
I20260806 11:51:21.111878 20577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:21.160625 20577 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:21.162295 20577 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:21.181563 20577 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b: Generated new TSK 0
I20260806 11:51:21.182906 20577 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:21.189107 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41699
--builtin_ntp_servers=127.26.172.212:34089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 11:51:21.318636 20589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:21.319077 20589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:21.319164 20589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:21.323637 20589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:21.323724 20589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:21.323817 20589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:51:21.328936 20589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:34089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:21.330211 20589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:21.331768 20589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:21.343909 20599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:21.344091 20589 server_base.cc:1034] running on GCE node
W20260806 11:51:21.343927 20602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:21.344398 20598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:21.344936 20589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:21.345745 20589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:21.346957 20589 hybrid_clock.cc:648] HybridClock initialized: now 1786017081346928 us; error 48 us; skew 500 ppm
I20260806 11:51:21.349386 20589 webserver.cc:460] Webserver started at http://127.26.172.193:38537/ using document root <none> and password file <none>
I20260806 11:51:21.350049 20589 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:21.350150 20589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:21.350399 20589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:21.352779 20589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "6660e7a33a754206acb74e84d4c7e75f"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "3a67ead47fce5d587e575c8a2da67cef"
server_key_iv: "fb1fa55e3d391b9858e7e7793d8256f4"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.353420 20589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "6660e7a33a754206acb74e84d4c7e75f"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "3a67ead47fce5d587e575c8a2da67cef"
server_key_iv: "fb1fa55e3d391b9858e7e7793d8256f4"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.357934 20589 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260806 11:51:21.361366 20611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:21.363147 20589 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 11:51:21.363339 20589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "6660e7a33a754206acb74e84d4c7e75f"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "3a67ead47fce5d587e575c8a2da67cef"
server_key_iv: "fb1fa55e3d391b9858e7e7793d8256f4"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.363489 20589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:21.391916 20589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:21.392766 20589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:21.393002 20589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:21.393702 20589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:21.394845 20589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:21.394925 20589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:21.395013 20589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:21.395058 20589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:21.406677 20589 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:46083
I20260806 11:51:21.406909 20771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:46083 every 8 connection(s)
I20260806 11:51:21.407886 20589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:51:21.410917 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 20589
I20260806 11:51:21.411089 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:51:21.411511 27315 external_mini_cluster.cc:1428] Setting key 104dc0fe55e47772547d76a0078c56c5
I20260806 11:51:21.414394 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41699
--builtin_ntp_servers=127.26.172.212:34089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 11:51:21.421833 20562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.410529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:50483 (local address 127.26.172.254:41699)
0806 11:51:21.410695 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:21.410701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:21.412470 (+ 1769us) server_negotiation.cc:407] Connection header received
0806 11:51:21.414776 (+ 2306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:21.414779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:21.414879 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:21.415000 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:21.416662 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.417568 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.419008 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.419276 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.419438 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.421181 (+ 1743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:21.421184 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:21.421187 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:21.421203 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:21.421227 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:21.421236 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:21.421308 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:21.421576 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 11:51:21.421644 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 11:51:21.423516 20774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.411076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41699 (local address 127.26.172.193:50483)
0806 11:51:21.412185 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:21.412276 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:21.414397 (+ 2121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:21.415345 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:21.415360 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:21.415515 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:21.416449 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.416474 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.417761 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.417764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.418809 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.418878 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.419624 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.419633 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.419904 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.420783 (+ 879us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:51:21.420787 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:21.420859 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:51:21.420971 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:21.421324 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:21.421339 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:21.421349 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 11:51:21.421554 (+ 205us) client_negotiation.cc:240] Negotiation successful
0806 11:51:21.421987 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":200,"threads_started":1}
I20260806 11:51:21.425328 20772 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41699
I20260806 11:51:21.425668 20772 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:21.426376 20772 heartbeater.cc:511] Master 127.26.172.254:41699 requested a full tablet report, sending...
I20260806 11:51:21.428185 20506 ts_manager.cc:194] Registered new tserver with Master: 6660e7a33a754206acb74e84d4c7e75f (127.26.172.193:46083)
I20260806 11:51:21.429469 20506 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.193:50483
W20260806 11:51:21.554584 20776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:21.555044 20776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:21.555135 20776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:21.559530 20776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:21.559608 20776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:21.559670 20776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:51:21.565209 20776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:34089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:21.566780 20776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:21.568765 20776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:21.581809 20788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:21.581809 20790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:21.581951 20776 server_base.cc:1034] running on GCE node
W20260806 11:51:21.581962 20785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:21.582993 20776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:21.583894 20776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:21.585105 20776 hybrid_clock.cc:648] HybridClock initialized: now 1786017081585078 us; error 46 us; skew 500 ppm
I20260806 11:51:21.587954 20776 webserver.cc:460] Webserver started at http://127.26.172.194:40787/ using document root <none> and password file <none>
I20260806 11:51:21.588812 20776 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:21.588892 20776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:21.589195 20776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:21.592267 20776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "7fcd53cebbdd476bbfeaeec2e6553048"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "37306a7cfbf1983749c60e54de980560"
server_key_iv: "7a322aeae1c44a12673a233edf1a9eae"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.593024 20776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "7fcd53cebbdd476bbfeaeec2e6553048"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "37306a7cfbf1983749c60e54de980560"
server_key_iv: "7a322aeae1c44a12673a233edf1a9eae"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.598912 20776 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 11:51:21.602751 20801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:21.604719 20776 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:51:21.604926 20776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "7fcd53cebbdd476bbfeaeec2e6553048"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "37306a7cfbf1983749c60e54de980560"
server_key_iv: "7a322aeae1c44a12673a233edf1a9eae"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.605108 20776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:21.619349 20776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:21.620306 20776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:21.620553 20776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:21.621366 20776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:21.622641 20776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:21.622704 20776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:21.622793 20776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:21.622850 20776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260806 11:51:21.635381 20776 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:34715
I20260806 11:51:21.635479 20964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:34715 every 8 connection(s)
I20260806 11:51:21.636686 20776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:51:21.646642 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 20776
I20260806 11:51:21.646801 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:51:21.647197 27315 external_mini_cluster.cc:1428] Setting key 1d1a4056d1dbb21d63ec247ef4b22f4a
I20260806 11:51:21.649397 20562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.639270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:34479 (local address 127.26.172.254:41699)
0806 11:51:21.639598 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:21.639604 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:21.641318 (+ 1714us) server_negotiation.cc:407] Connection header received
0806 11:51:21.642997 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:21.643001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:21.643083 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:21.643251 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:21.644356 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.645021 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.646362 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.646690 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.646934 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.648654 (+ 1720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:21.648659 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:21.648662 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:21.648679 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:21.648715 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:21.648727 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:21.648822 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:21.649085 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 11:51:21.649190 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174}
I20260806 11:51:21.650318 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41699
--builtin_ntp_servers=127.26.172.212:34089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 11:51:21.650660 20967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.640041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41699 (local address 127.26.172.194:34479)
0806 11:51:21.641096 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:21.641150 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:21.642664 (+ 1514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:21.643434 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:21.643441 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:21.643530 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:21.644183 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.644197 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.645185 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.645188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.646193 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.646204 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.647012 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.647017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.647263 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.648172 (+ 909us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:51:21.648174 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:21.648251 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:51:21.648425 (+ 174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:21.648867 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:21.648880 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:21.648886 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 11:51:21.649014 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 11:51:21.649441 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":162,"threads_started":1}
I20260806 11:51:21.652264 20965 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41699
I20260806 11:51:21.652801 20965 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:21.653682 20965 heartbeater.cc:511] Master 127.26.172.254:41699 requested a full tablet report, sending...
I20260806 11:51:21.655413 20506 ts_manager.cc:194] Registered new tserver with Master: 7fcd53cebbdd476bbfeaeec2e6553048 (127.26.172.194:34715)
I20260806 11:51:21.656155 20506 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.194:34479
W20260806 11:51:21.797034 20968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:21.797538 20968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:21.797641 20968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:21.802728 20968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:21.802852 20968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:21.802924 20968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:51:21.808660 20968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:34089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:41699
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:21.810530 20968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:21.812435 20968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:21.825737 20976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:21.825744 20975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:21.825776 20979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:21.826274 20968 server_base.cc:1034] running on GCE node
I20260806 11:51:21.827157 20968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:21.828233 20968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:21.829512 20968 hybrid_clock.cc:648] HybridClock initialized: now 1786017081829470 us; error 60 us; skew 500 ppm
I20260806 11:51:21.832410 20968 webserver.cc:460] Webserver started at http://127.26.172.195:41387/ using document root <none> and password file <none>
I20260806 11:51:21.833271 20968 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:21.833390 20968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:21.833699 20968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:21.836624 20968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "d7fc160d0b964df0b6bb9431be4dad45"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "f3cd8e4a64153f9c56829bdf7135db59"
server_key_iv: "7d3fc4307ecf61e782136182d72b3812"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.837564 20968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "d7fc160d0b964df0b6bb9431be4dad45"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "f3cd8e4a64153f9c56829bdf7135db59"
server_key_iv: "7d3fc4307ecf61e782136182d72b3812"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.843992 20968 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260806 11:51:21.848196 20989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:21.850376 20968 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260806 11:51:21.850636 20968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "d7fc160d0b964df0b6bb9431be4dad45"
format_stamp: "Formatted at 2026-08-06 11:51:21 on dist-test-slave-7z32"
server_key: "f3cd8e4a64153f9c56829bdf7135db59"
server_key_iv: "7d3fc4307ecf61e782136182d72b3812"
server_key_version: "encryptionkey@0"
I20260806 11:51:21.850893 20968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:21.878298 20968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:21.879451 20968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:21.879681 20968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:21.880496 20968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:21.882019 20968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:21.882082 20968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:21.882169 20968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:21.882220 20968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:21.895522 20968 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:39499
I20260806 11:51:21.895623 21146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:39499 every 8 connection(s)
I20260806 11:51:21.896981 20968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:51:21.902340 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 20968
I20260806 11:51:21.902501 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:51:21.903049 27315 external_mini_cluster.cc:1428] Setting key d9e7a4604e3f15b67ca8b1f55b1ff173
I20260806 11:51:21.910425 20562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.899990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:44817 (local address 127.26.172.254:41699)
0806 11:51:21.900228 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:21.900233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:21.901880 (+ 1647us) server_negotiation.cc:407] Connection header received
0806 11:51:21.903978 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:21.903984 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:21.904067 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:21.904181 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:21.905644 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.906434 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.907759 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.908016 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.908118 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.909757 (+ 1639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:21.909761 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:21.909764 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:21.909781 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:21.909807 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:21.909816 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:21.909887 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:21.910181 (+ 294us) server_negotiation.cc:299] Negotiation successful
0806 11:51:21.910259 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260806 11:51:21.911711 21152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.900628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41699 (local address 127.26.172.195:44817)
0806 11:51:21.901668 (+ 1040us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:21.901726 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:21.903640 (+ 1914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:21.904484 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:21.904496 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:21.904621 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:21.905461 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.905485 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.906607 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.906610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.907623 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.907635 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.908228 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.908232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.908499 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.909428 (+ 929us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:51:21.909430 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:21.909478 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:51:21.909572 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:21.909980 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:21.909994 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:21.910005 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 11:51:21.910159 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 11:51:21.910583 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":178,"threads_started":1}
I20260806 11:51:21.913493 21147 heartbeater.cc:347] Connected to a master server at 127.26.172.254:41699
I20260806 11:51:21.913843 21147 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:21.914518 21147 heartbeater.cc:511] Master 127.26.172.254:41699 requested a full tablet report, sending...
I20260806 11:51:21.916093 20506 ts_manager.cc:194] Registered new tserver with Master: d7fc160d0b964df0b6bb9431be4dad45 (127.26.172.195:39499)
I20260806 11:51:21.916949 20506 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.195:44817
I20260806 11:51:21.918540 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:51:21.927063 20562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.921523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46324 (local address 127.26.172.254:41699)
0806 11:51:21.921756 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:21.921760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:21.922076 (+ 316us) server_negotiation.cc:407] Connection header received
0806 11:51:21.922258 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:21.922260 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:21.922325 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:21.922419 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:21.922870 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.923490 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.924654 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.924875 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.924976 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.926267 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:21.926271 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:21.926274 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:21.926290 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:21.926326 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:21.926336 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:21.926471 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:21.926740 (+ 269us) server_negotiation.cc:299] Negotiation successful
0806 11:51:21.926796 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260806 11:51:21.931334 20506 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46324:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:51:21.934921 20506 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:51:21.954737 21167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.947014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:39499 (local address 127.0.0.1:46902)
0806 11:51:21.948357 (+ 1343us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:21.948437 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:21.948627 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:21.949378 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:21.949384 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:21.949409 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:21.949608 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.949617 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.951193 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.951196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.953095 (+ 1899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.953108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.954303 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.954306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.954405 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.954430 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 11:51:21.954506 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 11:51:21.954572 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1085,"mutex_wait_us":356,"thread_start_us":104,"threads_started":1}
I20260806 11:51:21.955318 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.948410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46902 (local address 127.26.172.195:39499)
0806 11:51:21.948913 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:21.948923 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:21.948942 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:51:21.949019 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:21.949023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:21.949197 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:21.949380 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:21.949762 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.951059 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.953252 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.953915 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.954034 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.954227 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:21.955005 (+ 778us) server_negotiation.cc:299] Negotiation successful
0806 11:51:21.955129 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":183,"threads_started":1}
I20260806 11:51:21.955978 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.947360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37078 (local address 127.26.172.193:46083)
0806 11:51:21.947957 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:21.947971 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:21.948566 (+ 595us) server_negotiation.cc:407] Connection header received
0806 11:51:21.948922 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:21.948933 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:21.949237 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:21.949430 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:21.950052 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.951244 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.953279 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.954230 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.954412 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.954636 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:21.955528 (+ 892us) server_negotiation.cc:299] Negotiation successful
0806 11:51:21.955681 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":103,"threads_started":1}
I20260806 11:51:21.956060 21171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.948035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45346 (local address 127.26.172.194:34715)
0806 11:51:21.949085 (+ 1050us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:21.949101 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:21.949136 (+ 35us) server_negotiation.cc:407] Connection header received
0806 11:51:21.949233 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:21.949240 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:21.949430 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:21.949634 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:21.949899 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.951169 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.952775 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.953632 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.953797 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.954059 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:21.955697 (+ 1638us) server_negotiation.cc:299] Negotiation successful
0806 11:51:21.955824 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":911,"thread_start_us":106,"threads_started":1}
I20260806 11:51:21.955358 21166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.947054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:46083 (local address 127.0.0.1:37078)
0806 11:51:21.948433 (+ 1379us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:21.948453 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:21.948673 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:21.949662 (+ 989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:21.949666 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:21.949689 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:21.949873 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.949884 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.951384 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.951390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.953095 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.953108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.954723 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.954727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.954874 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.954914 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 11:51:21.955010 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 11:51:21.955117 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1282,"mutex_wait_us":178,"thread_start_us":170,"threads_started":1}
I20260806 11:51:21.957119 21170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:21.947874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:34715 (local address 127.0.0.1:45346)
0806 11:51:21.948596 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:21.948614 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:21.948738 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:21.949620 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:21.949623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:21.949643 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:21.949747 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.949752 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.951347 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.951351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.952597 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:21.952611 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:21.953811 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:21.953815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:21.953945 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:21.954011 (+ 66us) client_negotiation.cc:769] Sending connection context
0806 11:51:21.954121 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 11:51:21.954281 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"mutex_wait_us":51,"thread_start_us":123,"threads_started":1}
I20260806 11:51:21.960665 21056 tablet_service.cc:1467] Processing CreateTablet for tablet 0aa89a59e35449ac9196020fe38ac6e9 (DEFAULT_TABLE table=test-table [id=b90c284f97fc4f99b784288de7bfcf41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:21.960665 20869 tablet_service.cc:1467] Processing CreateTablet for tablet 0aa89a59e35449ac9196020fe38ac6e9 (DEFAULT_TABLE table=test-table [id=b90c284f97fc4f99b784288de7bfcf41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:21.960629 20680 tablet_service.cc:1467] Processing CreateTablet for tablet 0aa89a59e35449ac9196020fe38ac6e9 (DEFAULT_TABLE table=test-table [id=b90c284f97fc4f99b784288de7bfcf41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:21.961973 21056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0aa89a59e35449ac9196020fe38ac6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:21.961973 20869 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0aa89a59e35449ac9196020fe38ac6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:21.961971 20680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0aa89a59e35449ac9196020fe38ac6e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:21.970882 21177 tablet_bootstrap.cc:492] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: Bootstrap starting.
I20260806 11:51:21.971654 21176 tablet_bootstrap.cc:492] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: Bootstrap starting.
I20260806 11:51:21.972023 21179 tablet_bootstrap.cc:492] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f: Bootstrap starting.
I20260806 11:51:21.974677 21179 tablet_bootstrap.cc:654] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:21.975330 21177 tablet_bootstrap.cc:654] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:21.975821 21179 log.cc:824] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:21.976503 21177 log.cc:824] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:21.978963 21179 tablet_bootstrap.cc:492] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f: No bootstrap required, opened a new log
I20260806 11:51:21.978976 21177 tablet_bootstrap.cc:492] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: No bootstrap required, opened a new log
I20260806 11:51:21.979225 21179 ts_tablet_manager.cc:1397] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.002s
I20260806 11:51:21.979225 21177 ts_tablet_manager.cc:1397] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260806 11:51:21.979928 21176 tablet_bootstrap.cc:654] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:21.980966 21176 log.cc:824] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:21.984088 21176 tablet_bootstrap.cc:492] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: No bootstrap required, opened a new log
I20260806 11:51:21.984402 21176 ts_tablet_manager.cc:1397] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260806 11:51:21.984146 21177 raft_consensus.cc:348] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 } } peers { permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 } } peers { permanent_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34715 } }
I20260806 11:51:21.984364 21179 raft_consensus.cc:348] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 } } peers { permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 } } peers { permanent_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34715 } }
I20260806 11:51:21.984555 21177 raft_consensus.cc:374] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:21.984612 21179 raft_consensus.cc:374] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:21.984619 21177 raft_consensus.cc:729] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fc160d0b964df0b6bb9431be4dad45, State: Initialized, Role: FOLLOWER
I20260806 11:51:21.984659 21179 raft_consensus.cc:729] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6660e7a33a754206acb74e84d4c7e75f, State: Initialized, Role: FOLLOWER
I20260806 11:51:21.985195 21177 consensus_queue.cc:260] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 } } peers { permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 } } peers { permanent_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34715 } }
I20260806 11:51:21.985195 21179 consensus_queue.cc:260] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 } } peers { permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 } } peers { permanent_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34715 } }
I20260806 11:51:21.986482 21179 ts_tablet_manager.cc:1428] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260806 11:51:21.986482 21177 ts_tablet_manager.cc:1428] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260806 11:51:21.986524 20772 heartbeater.cc:503] Master 127.26.172.254:41699 was elected leader, sending a full tablet report...
I20260806 11:51:21.987246 21147 heartbeater.cc:503] Master 127.26.172.254:41699 was elected leader, sending a full tablet report...
I20260806 11:51:21.990027 21176 raft_consensus.cc:348] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 } } peers { permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 } } peers { permanent_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34715 } }
I20260806 11:51:21.990527 21176 raft_consensus.cc:374] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:21.990640 21176 raft_consensus.cc:729] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fcd53cebbdd476bbfeaeec2e6553048, State: Initialized, Role: FOLLOWER
I20260806 11:51:21.991328 21176 consensus_queue.cc:260] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 } } peers { permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 } } peers { permanent_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34715 } }
I20260806 11:51:21.992467 20965 heartbeater.cc:503] Master 127.26.172.254:41699 was elected leader, sending a full tablet report...
I20260806 11:51:21.992834 21176 ts_tablet_manager.cc:1428] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
W20260806 11:51:22.138353 20966 tablet.cc:2369] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:51:22.148442 21148 tablet.cc:2369] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:51:22.159600 20773 tablet.cc:2369] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:51:22.234369 21188 raft_consensus.cc:482] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:22.234639 21188 raft_consensus.cc:504] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 } } peers { permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 } } peers { permanent_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34715 } }
I20260806 11:51:22.236043 21188 leader_election.cc:288] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6660e7a33a754206acb74e84d4c7e75f (127.26.172.193:46083), d7fc160d0b964df0b6bb9431be4dad45 (127.26.172.195:39499)
I20260806 11:51:22.241125 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:22.236856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:54331 (local address 127.26.172.193:46083)
0806 11:51:22.237051 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:22.237057 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:22.237232 (+ 175us) server_negotiation.cc:407] Connection header received
0806 11:51:22.237426 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:22.237429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:22.237481 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:22.237571 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:22.237909 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:22.238448 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:22.239971 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:22.240461 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:22.240589 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:22.240646 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:22.240897 (+ 251us) server_negotiation.cc:299] Negotiation successful
0806 11:51:22.240970 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260806 11:51:22.241205 21191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:22.236571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:46083 (local address 127.26.172.194:54331)
0806 11:51:22.237123 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:22.237139 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:22.237300 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:22.237590 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:22.237593 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:22.237612 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:22.237784 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:22.237798 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:22.238571 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:22.238575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:22.239823 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:22.239834 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:22.240588 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:22.240592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:22.240701 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:22.240727 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 11:51:22.240878 (+ 151us) client_negotiation.cc:240] Negotiation successful
0806 11:51:22.240971 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":1,"thread_start_us":151,"threads_started":1}
I20260806 11:51:22.241346 21174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:22.236731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:49991 (local address 127.26.172.195:39499)
0806 11:51:22.236896 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:22.236901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:22.236927 (+ 26us) server_negotiation.cc:407] Connection header received
0806 11:51:22.237198 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:22.237202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:22.237259 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:22.237370 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:22.237748 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:22.238404 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:22.240038 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:22.240545 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:22.240747 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:22.240823 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:22.241050 (+ 227us) server_negotiation.cc:299] Negotiation successful
0806 11:51:22.241151 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 11:51:22.241559 21190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:22.236457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:39499 (local address 127.26.172.194:49991)
0806 11:51:22.236821 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:22.236846 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:22.237006 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:22.237390 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:22.237394 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:22.237416 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:22.237618 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:22.237624 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:22.238556 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:22.238561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:22.239864 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:22.239877 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:22.240751 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:22.240756 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:22.240880 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:22.240903 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 11:51:22.241029 (+ 126us) client_negotiation.cc:240] Negotiation successful
0806 11:51:22.241138 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"mutex_wait_us":103,"thread_start_us":111,"threads_started":1}
I20260806 11:51:22.242646 21084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0aa89a59e35449ac9196020fe38ac6e9" candidate_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc160d0b964df0b6bb9431be4dad45" is_pre_election: true
I20260806 11:51:22.242630 20713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0aa89a59e35449ac9196020fe38ac6e9" candidate_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6660e7a33a754206acb74e84d4c7e75f" is_pre_election: true
I20260806 11:51:22.243104 21084 raft_consensus.cc:2454] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fcd53cebbdd476bbfeaeec2e6553048 in term 0.
I20260806 11:51:22.243167 20713 raft_consensus.cc:2454] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fcd53cebbdd476bbfeaeec2e6553048 in term 0.
I20260806 11:51:22.243896 20804 leader_election.cc:302] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6660e7a33a754206acb74e84d4c7e75f, 7fcd53cebbdd476bbfeaeec2e6553048; no voters:
I20260806 11:51:22.244351 21188 raft_consensus.cc:2781] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:51:22.244488 21188 raft_consensus.cc:482] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:51:22.244529 21188 raft_consensus.cc:3037] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:22.245862 21188 raft_consensus.cc:504] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 } } peers { permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 } } peers { permanent_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34715 } }
I20260806 11:51:22.246346 21188 leader_election.cc:288] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [CANDIDATE]: Term 1 election: Requested vote from peers 6660e7a33a754206acb74e84d4c7e75f (127.26.172.193:46083), d7fc160d0b964df0b6bb9431be4dad45 (127.26.172.195:39499)
I20260806 11:51:22.246927 21084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0aa89a59e35449ac9196020fe38ac6e9" candidate_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fc160d0b964df0b6bb9431be4dad45"
I20260806 11:51:22.246958 20713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0aa89a59e35449ac9196020fe38ac6e9" candidate_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6660e7a33a754206acb74e84d4c7e75f"
I20260806 11:51:22.247095 21084 raft_consensus.cc:3037] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:22.247126 20713 raft_consensus.cc:3037] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:22.248368 21084 raft_consensus.cc:2454] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fcd53cebbdd476bbfeaeec2e6553048 in term 1.
I20260806 11:51:22.248657 20713 raft_consensus.cc:2454] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fcd53cebbdd476bbfeaeec2e6553048 in term 1.
I20260806 11:51:22.248884 20805 leader_election.cc:302] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fcd53cebbdd476bbfeaeec2e6553048, d7fc160d0b964df0b6bb9431be4dad45; no voters:
I20260806 11:51:22.249222 21188 raft_consensus.cc:2781] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:22.249521 21188 raft_consensus.cc:686] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 1 LEADER]: Becoming Leader. State: Replica: 7fcd53cebbdd476bbfeaeec2e6553048, State: Running, Role: LEADER
I20260806 11:51:22.250054 21188 consensus_queue.cc:237] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 } } peers { permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 } } peers { permanent_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34715 } }
I20260806 11:51:22.254197 20506 catalog_manager.cc:5495] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fcd53cebbdd476bbfeaeec2e6553048 (127.26.172.194). New cstate: current_term: 1 leader_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fcd53cebbdd476bbfeaeec2e6553048" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 34715 } health_report { overall_health: HEALTHY } } }
I20260806 11:51:22.337044 21171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:22.332021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45360 (local address 127.26.172.194:34715)
0806 11:51:22.332222 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:22.332226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:22.332254 (+ 28us) server_negotiation.cc:407] Connection header received
0806 11:51:22.332364 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:22.332366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:22.332445 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:22.332644 (+ 199us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:51:22.332964 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:22.333642 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:22.334714 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:22.335150 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:22.335261 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:22.335667 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:51:22.336249 (+ 582us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:51:22.336412 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:22.336724 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 11:51:22.336855 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 11:51:22.345552 21084 raft_consensus.cc:1261] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45 [term 1 FOLLOWER]: Refusing update from remote peer 7fcd53cebbdd476bbfeaeec2e6553048: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:22.345700 20713 raft_consensus.cc:1261] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f [term 1 FOLLOWER]: Refusing update from remote peer 7fcd53cebbdd476bbfeaeec2e6553048: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:22.346633 21188 consensus_queue.cc:1035] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fc160d0b964df0b6bb9431be4dad45" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:22.346944 21194 consensus_queue.cc:1035] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6660e7a33a754206acb74e84d4c7e75f" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 46083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:22.357762 21200 mvcc.cc:205] Tried to move back new op lower bound from 7315525969276887040 to 7315525968899874816. Current Snapshot: MvccSnapshot[applied={T|T < 7315525969276887040 or (T in {7315525969276887040})}]
I20260806 11:51:22.360782 21201 mvcc.cc:205] Tried to move back new op lower bound from 7315525969276887040 to 7315525968899874816. Current Snapshot: MvccSnapshot[applied={T|T < 7315525969276887040 or (T in {7315525969276887040})}]
I20260806 11:51:22.367954 20503 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:22.368251 20503 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46324:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:22.371881 20503 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9515db5efed149d6b873f9025d9bbf1b: Sending DeleteTablet for 3 replicas of tablet 0aa89a59e35449ac9196020fe38ac6e9
I20260806 11:51:22.373049 20869 tablet_service.cc:1514] Processing DeleteTablet for tablet 0aa89a59e35449ac9196020fe38ac6e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:22 UTC) from {username='slave'} at 127.0.0.1:45346
I20260806 11:51:22.373229 20680 tablet_service.cc:1514] Processing DeleteTablet for tablet 0aa89a59e35449ac9196020fe38ac6e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:22 UTC) from {username='slave'} at 127.0.0.1:37078
I20260806 11:51:22.373700 21212 tablet_replica.cc:330] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: stopping tablet replica
I20260806 11:51:22.373708 21056 tablet_service.cc:1514] Processing DeleteTablet for tablet 0aa89a59e35449ac9196020fe38ac6e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:22 UTC) from {username='slave'} at 127.0.0.1:46902
I20260806 11:51:22.373979 21213 tablet_replica.cc:330] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f: stopping tablet replica
I20260806 11:51:22.374126 21212 raft_consensus.cc:2229] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:51:22.374430 21213 raft_consensus.cc:2229] T 0aa89a59e35449ac9196020fe38ac6e9 P 6660e7a33a754206acb74e84d4c7e75f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:22.374691 21212 raft_consensus.cc:2258] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:22.375049 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 20589
I20260806 11:51:22.387229 21212 ts_tablet_manager.cc:1905] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:22.387533 21215 tablet_replica.cc:330] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: stopping tablet replica
I20260806 11:51:22.387946 21215 raft_consensus.cc:2229] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:22.388393 21215 raft_consensus.cc:2258] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:22.392364 21212 ts_tablet_manager.cc:1918] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:22.392678 21212 log.cc:1196] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/0aa89a59e35449ac9196020fe38ac6e9
I20260806 11:51:22.393085 21212 ts_tablet_manager.cc:1939] T 0aa89a59e35449ac9196020fe38ac6e9 P 7fcd53cebbdd476bbfeaeec2e6553048: Deleting consensus metadata
I20260806 11:51:22.394726 21215 ts_tablet_manager.cc:1905] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:22.394927 20488 catalog_manager.cc:4841] TS 7fcd53cebbdd476bbfeaeec2e6553048 (127.26.172.194:34715): tablet 0aa89a59e35449ac9196020fe38ac6e9 (table test-table [id=b90c284f97fc4f99b784288de7bfcf41]) successfully deleted
I20260806 11:51:22.398717 21215 ts_tablet_manager.cc:1918] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:22.398928 21215 log.cc:1196] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/0aa89a59e35449ac9196020fe38ac6e9
I20260806 11:51:22.399350 21215 ts_tablet_manager.cc:1939] T 0aa89a59e35449ac9196020fe38ac6e9 P d7fc160d0b964df0b6bb9431be4dad45: Deleting consensus metadata
I20260806 11:51:22.401242 20491 catalog_manager.cc:4841] TS d7fc160d0b964df0b6bb9431be4dad45 (127.26.172.195:39499): tablet 0aa89a59e35449ac9196020fe38ac6e9 (table test-table [id=b90c284f97fc4f99b784288de7bfcf41]) successfully deleted
W20260806 11:51:22.403237 20489 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:46083 (error 108)
I20260806 11:51:22.403401 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 20776
I20260806 11:51:22.416374 21170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:22.415754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:46083 (local address 127.0.0.1:37086)
0806 11:51:22.416083 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:22.416213 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194}
W20260806 11:51:22.416831 20489 catalog_manager.cc:4584] TS 6660e7a33a754206acb74e84d4c7e75f (127.26.172.193:46083): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0aa89a59e35449ac9196020fe38ac6e9: Network error: Client connection negotiation failed: client connection to 127.26.172.193:46083: connect: Connection refused (error 111)
I20260806 11:51:22.426015 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 20968
I20260806 11:51:22.444290 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 20467
2026-08-06T11:51:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1633 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:22 dist-test-slave-7z32 krb5kdc[21219](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:22 dist-test-slave-7z32 krb5kdc[21219](info): set up 2 sockets
Aug 06 11:51:22 dist-test-slave-7z32 krb5kdc[21219](info): commencing operation
krb5kdc: starting...
W20260806 11:51:23.762919 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:23 dist-test-slave-7z32 krb5kdc[21219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:51:23.931411 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:36187
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:36187
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:24.065603 21237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:24.065973 21237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:24.066056 21237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:24.070288 21237 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:24.070405 21237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:24.070447 21237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:24.070508 21237 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:24.070546 21237 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:24.076148 21237 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:36187
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:36187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:24.077371 21237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:24.078524 21237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:24.088768 21248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:24.088730 21244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:24.088896 21237 server_base.cc:1034] running on GCE node
W20260806 11:51:24.089123 21245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:24.089802 21237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:24.091110 21237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:24.092386 21237 hybrid_clock.cc:648] HybridClock initialized: now 1786017084092350 us; error 55 us; skew 500 ppm
Aug 06 11:51:24 dist-test-slave-7z32 krb5kdc[21219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017084, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:24.095685 21237 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:51:24.096787 21237 webserver.cc:460] Webserver started at http://127.26.172.254:34917/ using document root <none> and password file <none>
I20260806 11:51:24.097496 21237 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:24.097591 21237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:24.097829 21237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:24.100152 21237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "e48b2c3311e64d8a945357923848fc3b"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "c754b1baf70c7081325e6cb491802e14"
server_key_iv: "7ec1f7e7ded4e7601babea07cf44a9f8"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.100768 21237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "e48b2c3311e64d8a945357923848fc3b"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "c754b1baf70c7081325e6cb491802e14"
server_key_iv: "7ec1f7e7ded4e7601babea07cf44a9f8"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.105221 21237 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 11:51:24.108383 21257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:24.110001 21237 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 11:51:24.110163 21237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "e48b2c3311e64d8a945357923848fc3b"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "c754b1baf70c7081325e6cb491802e14"
server_key_iv: "7ec1f7e7ded4e7601babea07cf44a9f8"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.110291 21237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:24.126432 21237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:24.130018 21237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:24.130236 21237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:24.138811 21237 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:36187
I20260806 11:51:24.139052 21321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:36187 every 8 connection(s)
I20260806 11:51:24.139997 21237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:24.142802 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 21237
I20260806 11:51:24.143043 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:24.143471 27315 external_mini_cluster.cc:1428] Setting key ed7e9b90dd265aab1874469ebbaa043e
I20260806 11:51:24.144558 21322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:24.152719 21322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b: Bootstrap starting.
Aug 06 11:51:24 dist-test-slave-7z32 krb5kdc[21219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:24.156494 21322 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:24.157536 21322 log.cc:824] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:24.160981 21322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b: No bootstrap required, opened a new log
I20260806 11:51:24.162016 21326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:24.145435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44144 (local address 127.26.172.254:36187)
0806 11:51:24.146091 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:24.146121 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:24.146165 (+ 44us) server_negotiation.cc:407] Connection header received
0806 11:51:24.147034 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:24.147058 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:24.147522 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:24.147951 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:24.148925 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:24.150079 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:24.151124 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:24.151660 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:24.151851 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:24.155526 (+ 3675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:24.155532 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:24.155552 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:24.155588 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:24.157725 (+ 2137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:24.158402 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:24.158417 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:24.158424 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:24.158623 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:24.159083 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:24.159087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:24.159089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:24.159840 (+ 751us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:24.160086 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:24.160433 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 11:51:24.160867 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":214,"threads_started":1}
I20260806 11:51:24.165900 21322 raft_consensus.cc:348] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48b2c3311e64d8a945357923848fc3b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36187 } }
I20260806 11:51:24.166180 21322 raft_consensus.cc:374] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:24.166218 21322 raft_consensus.cc:729] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e48b2c3311e64d8a945357923848fc3b, State: Initialized, Role: FOLLOWER
I20260806 11:51:24.166648 21322 consensus_queue.cc:260] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48b2c3311e64d8a945357923848fc3b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36187 } }
I20260806 11:51:24.166770 21322 raft_consensus.cc:388] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:24.166883 21322 raft_consensus.cc:482] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:24.166994 21322 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:24.168334 21322 raft_consensus.cc:504] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48b2c3311e64d8a945357923848fc3b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36187 } }
I20260806 11:51:24.168682 21322 leader_election.cc:302] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e48b2c3311e64d8a945357923848fc3b; no voters:
I20260806 11:51:24.169158 21322 leader_election.cc:288] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:24.169344 21328 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:24.169718 21328 raft_consensus.cc:686] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [term 1 LEADER]: Becoming Leader. State: Replica: e48b2c3311e64d8a945357923848fc3b, State: Running, Role: LEADER
I20260806 11:51:24.170107 21328 consensus_queue.cc:237] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48b2c3311e64d8a945357923848fc3b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36187 } }
I20260806 11:51:24.170642 21322 sys_catalog.cc:564] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:24.172201 21334 sys_catalog.cc:455] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e48b2c3311e64d8a945357923848fc3b. Latest consensus state: current_term: 1 leader_uuid: "e48b2c3311e64d8a945357923848fc3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48b2c3311e64d8a945357923848fc3b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36187 } } }
I20260806 11:51:24.172353 21334 sys_catalog.cc:458] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:24.172309 21332 sys_catalog.cc:455] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e48b2c3311e64d8a945357923848fc3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48b2c3311e64d8a945357923848fc3b" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36187 } } }
I20260806 11:51:24.172447 21332 sys_catalog.cc:458] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:24.172827 21344 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:24.176384 21344 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:24.182717 21344 catalog_manager.cc:1347] Generated new cluster ID: afafd6afc87447dfb8ca7131fdbdfdf6
I20260806 11:51:24.182874 21344 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:24.194887 21344 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:24.195995 21344 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:24.202387 21344 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b: Generated new TSK 0
I20260806 11:51:24.203229 21344 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.172.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
Entry for principal kudu/127.26.172.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab.
I20260806 11:51:24.239362 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:36187
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:24.363117 21360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:24.363430 21360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:24.363487 21360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:24.367686 21360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:24.367766 21360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:24.367828 21360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:51:24.373724 21360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.193.keytab
--principal=kudu/127.26.172.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:36187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:24.374912 21360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:24.375962 21360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:24.387872 21366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:24.388144 21360 server_base.cc:1034] running on GCE node
W20260806 11:51:24.387859 21372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:24.387882 21365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:24.388863 21360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:24.389701 21360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:24.390951 21360 hybrid_clock.cc:648] HybridClock initialized: now 1786017084390922 us; error 49 us; skew 500 ppm
Aug 06 11:51:24 dist-test-slave-7z32 krb5kdc[21219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017084, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:24.394198 21360 init.cc:377] Logged in from keytab as kudu/127.26.172.193@KRBTEST.COM (short username kudu)
I20260806 11:51:24.395334 21360 webserver.cc:460] Webserver started at http://127.26.172.193:45841/ using document root <none> and password file <none>
I20260806 11:51:24.395980 21360 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:24.396078 21360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:24.396342 21360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:24.398797 21360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "37711bba89e447318ccd8676abf22e9d"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "a7ef2d51da67a418a96862242dc7b75d"
server_key_iv: "2c2f411435ee3c3823453ab168c6c07a"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.399551 21360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "37711bba89e447318ccd8676abf22e9d"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "a7ef2d51da67a418a96862242dc7b75d"
server_key_iv: "2c2f411435ee3c3823453ab168c6c07a"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.404771 21360 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:51:24.408253 21383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:24.411074 21360 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:51:24.411321 21360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "37711bba89e447318ccd8676abf22e9d"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "a7ef2d51da67a418a96862242dc7b75d"
server_key_iv: "2c2f411435ee3c3823453ab168c6c07a"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.411528 21360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:24.433947 21360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:24.438385 21360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:24.438670 21360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:24.439553 21360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:24.440681 21360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:24.440760 21360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:24.440846 21360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:24.440897 21360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:24.453068 21360 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:41519
I20260806 11:51:24.453105 21541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:41519 every 8 connection(s)
I20260806 11:51:24.454247 21360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:51:24.463090 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 21360
I20260806 11:51:24.463281 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:51:24.463657 27315 external_mini_cluster.cc:1428] Setting key 8dc5077bf04d8e328342480e07ed9d77
Aug 06 11:51:24 dist-test-slave-7z32 krb5kdc[21219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017084, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.193@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:24.472388 21326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:24.456639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:41215 (local address 127.26.172.254:36187)
0806 11:51:24.456847 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:24.456853 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:24.457894 (+ 1041us) server_negotiation.cc:407] Connection header received
0806 11:51:24.459620 (+ 1726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:24.459624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:24.459682 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:24.459785 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:24.461458 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:24.462023 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:24.463704 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:24.464058 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:24.464204 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:24.467448 (+ 3244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:24.467455 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:24.467461 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:24.467502 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:24.469328 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:24.470124 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:24.470130 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:24.470135 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:24.470279 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:24.470652 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:24.470659 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:24.470663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:24.470988 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:24.471104 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:24.471909 (+ 805us) server_negotiation.cc:299] Negotiation successful
0806 11:51:24.472113 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 11:51:24.473505 21545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:24.457020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:36187 (local address 127.26.172.193:41215)
0806 11:51:24.457649 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:24.457707 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:24.459357 (+ 1650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:24.460072 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:24.460084 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:24.460582 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:24.461263 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:24.461281 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:24.462189 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:24.462192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:24.463532 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:24.463543 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:24.464298 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:24.464302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:24.464521 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:24.465289 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:51:24.465311 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:24.467213 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:24.469528 (+ 2315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:24.469538 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:24.469561 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:24.469961 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:24.470384 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:24.470387 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:24.470388 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:24.470536 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:24.471111 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:24.471118 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:24.471480 (+ 362us) client_negotiation.cc:769] Sending connection context
0806 11:51:24.471821 (+ 341us) client_negotiation.cc:240] Negotiation successful
0806 11:51:24.472181 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":158,"threads_started":1}
I20260806 11:51:24.475629 21543 heartbeater.cc:347] Connected to a master server at 127.26.172.254:36187
I20260806 11:51:24.476111 21543 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:24.476909 21543 heartbeater.cc:511] Master 127.26.172.254:36187 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.172.194@KRBTEST.COM; defaulting to no policy
I20260806 11:51:24.479534 21277 ts_manager.cc:194] Registered new tserver with Master: 37711bba89e447318ccd8676abf22e9d (127.26.172.193:41519)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.194@KRBTEST.COM" created.
I20260806 11:51:24.481438 21277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.193@KRBTEST.COM'} at 127.26.172.193:41215
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
Entry for principal kudu/127.26.172.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab.
I20260806 11:51:24.503773 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:36187
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:24.626927 21548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:24.627230 21548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:24.627276 21548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:24.631481 21548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:24.631573 21548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:24.631637 21548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:51:24.637446 21548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.194.keytab
--principal=kudu/127.26.172.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:36187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:24.638684 21548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:24.639815 21548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:24.651686 21557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:24.651710 21556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:24.651932 21548 server_base.cc:1034] running on GCE node
W20260806 11:51:24.651827 21562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:24.652644 21548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:24.653703 21548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:24.655010 21548 hybrid_clock.cc:648] HybridClock initialized: now 1786017084654968 us; error 66 us; skew 500 ppm
Aug 06 11:51:24 dist-test-slave-7z32 krb5kdc[21219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017084, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:24.664538 21548 init.cc:377] Logged in from keytab as kudu/127.26.172.194@KRBTEST.COM (short username kudu)
I20260806 11:51:24.665722 21548 webserver.cc:460] Webserver started at http://127.26.172.194:41653/ using document root <none> and password file <none>
I20260806 11:51:24.666390 21548 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:24.666465 21548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:24.666702 21548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:24.669013 21548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "42580159878ff176982fecc87d38b6c7"
server_key_iv: "2f0f8dda33d66a685f448b8ab72f9e00"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.669637 21548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "42580159878ff176982fecc87d38b6c7"
server_key_iv: "2f0f8dda33d66a685f448b8ab72f9e00"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.674687 21548 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:51:24.677821 21571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:24.679557 21548 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 11:51:24.679724 21548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "42580159878ff176982fecc87d38b6c7"
server_key_iv: "2f0f8dda33d66a685f448b8ab72f9e00"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.679883 21548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:24.699317 21548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:24.703223 21548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:24.703480 21548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:24.704293 21548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:24.705289 21548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:24.705368 21548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:24.705470 21548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:24.705516 21548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:24.717464 21548 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:33699
I20260806 11:51:24.717556 21720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:33699 every 8 connection(s)
I20260806 11:51:24.718773 21548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:51:24.724426 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 21548
I20260806 11:51:24.724637 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:51:24.725018 27315 external_mini_cluster.cc:1428] Setting key 68722b73ada5db5cb205c6e257129ced
Aug 06 11:51:24 dist-test-slave-7z32 krb5kdc[21219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017084, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.194@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:24.737776 21326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:24.721339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:39605 (local address 127.26.172.254:36187)
0806 11:51:24.721494 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:24.721499 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:24.722758 (+ 1259us) server_negotiation.cc:407] Connection header received
0806 11:51:24.724331 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:24.724334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:24.724392 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:24.724512 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:24.726057 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:24.726970 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:24.728961 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:24.729370 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:24.729535 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:24.732957 (+ 3422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:24.732961 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:24.732964 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:24.732993 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:24.734570 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:24.735244 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:24.735248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:24.735250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:24.735336 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:24.735924 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:24.735933 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:24.735938 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:24.736367 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:24.736522 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:24.737298 (+ 776us) server_negotiation.cc:299] Negotiation successful
0806 11:51:24.737502 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 11:51:24.738428 21724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:24.721938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:36187 (local address 127.26.172.194:39605)
0806 11:51:24.722574 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:24.722629 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:24.724082 (+ 1453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:24.724728 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:24.724739 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:24.725226 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:24.725810 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:24.725829 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:24.727145 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:24.727148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:24.728761 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:24.728781 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:24.729603 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:24.729610 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:24.729870 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:24.730600 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:51:24.730618 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:24.732739 (+ 2121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:24.734711 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:24.734718 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:24.734737 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:24.735130 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:24.735477 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:24.735480 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:24.735482 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:24.735692 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:24.736564 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:24.736572 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:24.736954 (+ 382us) client_negotiation.cc:769] Sending connection context
0806 11:51:24.737138 (+ 184us) client_negotiation.cc:240] Negotiation successful
0806 11:51:24.737435 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":157,"threads_started":1}
WARNING: no policy specified for kudu/127.26.172.195@KRBTEST.COM; defaulting to no policy
I20260806 11:51:24.739964 21722 heartbeater.cc:347] Connected to a master server at 127.26.172.254:36187
I20260806 11:51:24.740373 21722 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:24.741276 21722 heartbeater.cc:511] Master 127.26.172.254:36187 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.195@KRBTEST.COM" created.
I20260806 11:51:24.742717 21277 ts_manager.cc:194] Registered new tserver with Master: f2abac1eb9ee48a0bc7b34b7055fbca9 (127.26.172.194:33699)
I20260806 11:51:24.743436 21277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.194@KRBTEST.COM'} at 127.26.172.194:39605
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
Entry for principal kudu/127.26.172.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab.
I20260806 11:51:24.766645 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:36187
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:24.902768 21727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:24.903116 21727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:24.903162 21727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:24.907624 21727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:24.907707 21727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:24.907773 21727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:51:24.913641 21727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.195.keytab
--principal=kudu/127.26.172.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:36187
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:24.914970 21727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:24.916109 21727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:24.927323 21732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:24.927379 21734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:24.927379 21737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:24.927942 21727 server_base.cc:1034] running on GCE node
I20260806 11:51:24.928514 21727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:24.929427 21727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:24.930696 21727 hybrid_clock.cc:648] HybridClock initialized: now 1786017084930647 us; error 66 us; skew 500 ppm
Aug 06 11:51:24 dist-test-slave-7z32 krb5kdc[21219](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017084, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:24.934281 21727 init.cc:377] Logged in from keytab as kudu/127.26.172.195@KRBTEST.COM (short username kudu)
I20260806 11:51:24.935572 21727 webserver.cc:460] Webserver started at http://127.26.172.195:37007/ using document root <none> and password file <none>
I20260806 11:51:24.936374 21727 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:24.936507 21727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:24.936800 21727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:24.939548 21727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "1d3004d8c477487192293b82be32538f"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "faa948ed7529d4a81433b8da95df2d72"
server_key_iv: "b01656fd463d50e4ba65ea6447d5bba5"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.940261 21727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "1d3004d8c477487192293b82be32538f"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "faa948ed7529d4a81433b8da95df2d72"
server_key_iv: "b01656fd463d50e4ba65ea6447d5bba5"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.946220 21727 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260806 11:51:24.949697 21750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:24.951643 21727 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 11:51:24.951830 21727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "1d3004d8c477487192293b82be32538f"
format_stamp: "Formatted at 2026-08-06 11:51:24 on dist-test-slave-7z32"
server_key: "faa948ed7529d4a81433b8da95df2d72"
server_key_iv: "b01656fd463d50e4ba65ea6447d5bba5"
server_key_version: "encryptionkey@0"
I20260806 11:51:24.951982 21727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:24.979250 21727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:24.983873 21727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:24.984169 21727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:24.985071 21727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:24.986261 21727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:24.986328 21727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:24.986378 21727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:24.986397 21727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:24.999995 21727 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:46755
I20260806 11:51:25.000072 21910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:46755 every 8 connection(s)
I20260806 11:51:25.001443 21727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:51:25.008345 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 21727
I20260806 11:51:25.008535 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:51:25.008924 27315 external_mini_cluster.cc:1428] Setting key d08362c75f03fe823e1992f0bff50758
Aug 06 11:51:25 dist-test-slave-7z32 krb5kdc[21219](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017084, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.195@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:25.020658 21326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.004363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:42117 (local address 127.26.172.254:36187)
0806 11:51:25.004584 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:25.004589 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:25.005923 (+ 1334us) server_negotiation.cc:407] Connection header received
0806 11:51:25.007597 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:25.007601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:25.007695 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:25.007820 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:25.009694 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.010439 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.012104 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.012369 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.012468 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.015836 (+ 3368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:25.015840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:25.015843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:25.015879 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:25.017720 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:25.018615 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:25.018618 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:25.018620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:25.018716 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:25.019260 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:25.019263 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:25.019264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:25.019504 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:25.019689 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:25.020318 (+ 629us) server_negotiation.cc:299] Negotiation successful
0806 11:51:25.020475 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260806 11:51:25.021595 21916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.004924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:36187 (local address 127.26.172.195:42117)
0806 11:51:25.005683 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:25.005749 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:25.007307 (+ 1558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:25.008068 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:25.008088 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:25.008737 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:25.009476 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.009494 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.010605 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.010607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.011929 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.011966 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.012553 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.012556 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.012708 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.013460 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:51:25.013479 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:25.015601 (+ 2122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:25.017964 (+ 2363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:25.017971 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:25.017988 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:25.018416 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:25.018873 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:51:25.018883 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:51:25.018884 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:51:25.019133 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:51:25.019679 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:25.019685 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:25.019990 (+ 305us) client_negotiation.cc:769] Sending connection context
0806 11:51:25.020178 (+ 188us) client_negotiation.cc:240] Negotiation successful
0806 11:51:25.020545 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":185,"threads_started":1}
I20260806 11:51:25.023252 21914 heartbeater.cc:347] Connected to a master server at 127.26.172.254:36187
I20260806 11:51:25.023568 21914 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:25.024183 21914 heartbeater.cc:511] Master 127.26.172.254:36187 requested a full tablet report, sending...
I20260806 11:51:25.025501 21277 ts_manager.cc:194] Registered new tserver with Master: 1d3004d8c477487192293b82be32538f (127.26.172.195:46755)
I20260806 11:51:25.026340 21277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.172.195@KRBTEST.COM'} at 127.26.172.195:42117
I20260806 11:51:25.037707 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:51:25.049602 21326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.040732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44154 (local address 127.26.172.254:36187)
0806 11:51:25.040956 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:25.040960 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:25.040986 (+ 26us) server_negotiation.cc:407] Connection header received
0806 11:51:25.041046 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:25.041049 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:25.041101 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:25.041211 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:25.042084 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.042692 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.043656 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.043891 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.044002 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.045615 (+ 1613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:25.045618 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:25.045620 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:25.045646 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:25.047560 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:25.048171 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:25.048174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:25.048175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:25.048264 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:25.048603 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:25.048606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:25.048607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:25.048866 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:25.049002 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:25.049320 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 11:51:25.049451 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260806 11:51:25.053447 21277 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44154:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:51:25.057578 21277 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:51:25.075757 21934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.069492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:33699 (local address 127.0.0.1:51946)
0806 11:51:25.069862 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:25.069878 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:25.070001 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:25.070711 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:25.070714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:25.070744 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:25.071018 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.071027 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.072725 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.072731 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.073838 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.073849 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.075079 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.075083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.075209 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.075251 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 11:51:25.075398 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 11:51:25.075554 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":91,"spinlock_wait_cycles":4224,"thread_start_us":113,"threads_started":1}
I20260806 11:51:25.075922 21935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.069660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51946 (local address 127.26.172.194:33699)
0806 11:51:25.070100 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:25.070114 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:25.070144 (+ 30us) server_negotiation.cc:407] Connection header received
0806 11:51:25.070215 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:25.070219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:25.070488 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:25.070656 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:25.071164 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.072512 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.073983 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.074701 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.074835 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.075008 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:25.075497 (+ 489us) server_negotiation.cc:299] Negotiation successful
0806 11:51:25.075715 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":121,"threads_started":1}
I20260806 11:51:25.076660 21929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.068448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:46755 (local address 127.0.0.1:34118)
0806 11:51:25.069515 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:25.069582 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:25.069834 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:25.070527 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:25.070536 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:25.070569 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:25.070775 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.070797 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.072684 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.072691 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.074691 (+ 2000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.074703 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.076201 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.076205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.076305 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.076331 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 11:51:25.076418 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 11:51:25.076505 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":827,"mutex_wait_us":273,"spinlock_wait_cycles":5760,"thread_start_us":108,"threads_started":1}
I20260806 11:51:25.076931 21931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.068795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34118 (local address 127.26.172.195:46755)
0806 11:51:25.069251 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:25.069264 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:25.070010 (+ 746us) server_negotiation.cc:407] Connection header received
0806 11:51:25.070102 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:25.070107 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:25.070323 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:25.070493 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:25.071036 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.072512 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.074881 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.075818 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.075963 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.076127 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:25.076513 (+ 386us) server_negotiation.cc:299] Negotiation successful
0806 11:51:25.076682 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":132,"threads_started":1}
I20260806 11:51:25.076959 21930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.068743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60752 (local address 127.26.172.193:41519)
0806 11:51:25.069188 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:25.069199 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:25.069697 (+ 498us) server_negotiation.cc:407] Connection header received
0806 11:51:25.070047 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:25.070054 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:25.070347 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:25.070484 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:25.071550 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.072576 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.074602 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.075550 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.075691 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.075827 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:25.076691 (+ 864us) server_negotiation.cc:299] Negotiation successful
0806 11:51:25.076823 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":133,"threads_started":1}
I20260806 11:51:25.077644 21932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.068452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:41519 (local address 127.0.0.1:60752)
0806 11:51:25.069515 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:25.069582 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:25.069834 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:25.070711 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:25.070714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:25.070741 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:25.071403 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.071410 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.072744 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.072747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.074404 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.074416 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.076378 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.076381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.076514 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.076544 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 11:51:25.077411 (+ 867us) client_negotiation.cc:240] Negotiation successful
0806 11:51:25.077513 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":936,"mutex_wait_us":1224,"spinlock_wait_cycles":11008,"thread_start_us":103,"threads_started":1}
I20260806 11:51:25.080006 21814 tablet_service.cc:1467] Processing CreateTablet for tablet 6d9c63398c9347e6ab1801db00672ffb (DEFAULT_TABLE table=test-table [id=4d1368d2cf89438485b19c0a7b86a470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:25.080008 21640 tablet_service.cc:1467] Processing CreateTablet for tablet 6d9c63398c9347e6ab1801db00672ffb (DEFAULT_TABLE table=test-table [id=4d1368d2cf89438485b19c0a7b86a470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:25.080601 21446 tablet_service.cc:1467] Processing CreateTablet for tablet 6d9c63398c9347e6ab1801db00672ffb (DEFAULT_TABLE table=test-table [id=4d1368d2cf89438485b19c0a7b86a470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:25.081477 21640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d9c63398c9347e6ab1801db00672ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:25.081477 21814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d9c63398c9347e6ab1801db00672ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:25.081825 21446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d9c63398c9347e6ab1801db00672ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:25.088944 21936 tablet_bootstrap.cc:492] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d: Bootstrap starting.
I20260806 11:51:25.091334 21938 tablet_bootstrap.cc:492] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: Bootstrap starting.
I20260806 11:51:25.092669 21936 tablet_bootstrap.cc:654] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:25.093549 21938 tablet_bootstrap.cc:654] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:25.093633 21936 log.cc:824] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:25.094671 21939 tablet_bootstrap.cc:492] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: Bootstrap starting.
I20260806 11:51:25.094923 21938 log.cc:824] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:25.096570 21936 tablet_bootstrap.cc:492] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d: No bootstrap required, opened a new log
I20260806 11:51:25.096841 21939 tablet_bootstrap.cc:654] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:25.096881 21936 ts_tablet_manager.cc:1397] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 11:51:25.097949 21938 tablet_bootstrap.cc:492] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: No bootstrap required, opened a new log
I20260806 11:51:25.098176 21938 ts_tablet_manager.cc:1397] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260806 11:51:25.098506 21939 log.cc:824] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:25.100890 21939 tablet_bootstrap.cc:492] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: No bootstrap required, opened a new log
I20260806 11:51:25.101111 21939 ts_tablet_manager.cc:1397] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.002s
I20260806 11:51:25.101725 21936 raft_consensus.cc:348] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3004d8c477487192293b82be32538f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46755 } } peers { permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 } } peers { permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 } }
I20260806 11:51:25.102058 21936 raft_consensus.cc:374] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:25.102125 21936 raft_consensus.cc:729] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37711bba89e447318ccd8676abf22e9d, State: Initialized, Role: FOLLOWER
I20260806 11:51:25.102398 21938 raft_consensus.cc:348] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3004d8c477487192293b82be32538f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46755 } } peers { permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 } } peers { permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 } }
I20260806 11:51:25.102713 21938 raft_consensus.cc:374] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:25.102777 21938 raft_consensus.cc:729] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3004d8c477487192293b82be32538f, State: Initialized, Role: FOLLOWER
I20260806 11:51:25.102679 21936 consensus_queue.cc:260] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3004d8c477487192293b82be32538f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46755 } } peers { permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 } } peers { permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 } }
I20260806 11:51:25.103325 21938 consensus_queue.cc:260] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3004d8c477487192293b82be32538f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46755 } } peers { permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 } } peers { permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 } }
I20260806 11:51:25.105232 21914 heartbeater.cc:503] Master 127.26.172.254:36187 was elected leader, sending a full tablet report...
I20260806 11:51:25.105453 21938 ts_tablet_manager.cc:1428] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260806 11:51:25.105600 21543 heartbeater.cc:503] Master 127.26.172.254:36187 was elected leader, sending a full tablet report...
I20260806 11:51:25.105659 21936 ts_tablet_manager.cc:1428] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260806 11:51:25.108744 21939 raft_consensus.cc:348] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3004d8c477487192293b82be32538f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46755 } } peers { permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 } } peers { permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 } }
I20260806 11:51:25.109084 21939 raft_consensus.cc:374] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:25.109143 21939 raft_consensus.cc:729] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2abac1eb9ee48a0bc7b34b7055fbca9, State: Initialized, Role: FOLLOWER
I20260806 11:51:25.109670 21939 consensus_queue.cc:260] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3004d8c477487192293b82be32538f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46755 } } peers { permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 } } peers { permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 } }
I20260806 11:51:25.110518 21722 heartbeater.cc:503] Master 127.26.172.254:36187 was elected leader, sending a full tablet report...
I20260806 11:51:25.110920 21939 ts_tablet_manager.cc:1428] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: Time spent starting tablet: real 0.010s user 0.007s sys 0.001s
I20260806 11:51:25.189252 21947 raft_consensus.cc:482] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:25.189543 21947 raft_consensus.cc:504] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3004d8c477487192293b82be32538f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46755 } } peers { permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 } } peers { permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 } }
I20260806 11:51:25.191078 21947 leader_election.cc:288] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37711bba89e447318ccd8676abf22e9d (127.26.172.193:41519), f2abac1eb9ee48a0bc7b34b7055fbca9 (127.26.172.194:33699)
I20260806 11:51:25.196221 21916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.191375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:41519 (local address 127.26.172.195:39891)
0806 11:51:25.191609 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:25.191632 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:25.191831 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:25.192208 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:25.192213 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:25.192243 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:25.192421 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.192428 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.193528 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.193533 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.194624 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.194637 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.195725 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.195728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.195908 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.195937 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 11:51:25.196017 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 11:51:25.196095 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"mutex_wait_us":1}
I20260806 11:51:25.196353 21930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.191642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:39891 (local address 127.26.172.193:41519)
0806 11:51:25.191833 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:25.191841 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:25.191869 (+ 28us) server_negotiation.cc:407] Connection header received
0806 11:51:25.191987 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:25.191990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:25.192063 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:25.192169 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:25.192612 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.193419 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.194763 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.195551 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.195707 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.195779 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:25.196059 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 11:51:25.196163 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 11:51:25.197075 21951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.191723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:33699 (local address 127.26.172.195:60985)
0806 11:51:25.192184 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:25.192198 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:25.192356 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:25.192766 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:25.192771 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:25.192800 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:25.192951 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.192958 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.193834 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.193840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.195150 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.195167 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.196587 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.196591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.196696 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.196748 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 11:51:25.196850 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 11:51:25.196924 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":31,"thread_start_us":153,"threads_started":1}
I20260806 11:51:25.197084 21935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.191920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:60985 (local address 127.26.172.194:33699)
0806 11:51:25.192119 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:25.192124 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:25.192279 (+ 155us) server_negotiation.cc:407] Connection header received
0806 11:51:25.192575 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:25.192579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:25.192649 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:25.192741 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:25.193073 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.193708 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.195454 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.196163 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.196299 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.196348 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:25.196895 (+ 547us) server_negotiation.cc:299] Negotiation successful
0806 11:51:25.196973 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 11:51:25.197211 21477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d9c63398c9347e6ab1801db00672ffb" candidate_uuid: "1d3004d8c477487192293b82be32538f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37711bba89e447318ccd8676abf22e9d" is_pre_election: true
I20260806 11:51:25.197674 21477 raft_consensus.cc:2454] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d3004d8c477487192293b82be32538f in term 0.
I20260806 11:51:25.197803 21665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d9c63398c9347e6ab1801db00672ffb" candidate_uuid: "1d3004d8c477487192293b82be32538f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" is_pre_election: true
I20260806 11:51:25.198105 21665 raft_consensus.cc:2454] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d3004d8c477487192293b82be32538f in term 0.
I20260806 11:51:25.198432 21752 leader_election.cc:302] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3004d8c477487192293b82be32538f, 37711bba89e447318ccd8676abf22e9d; no voters:
I20260806 11:51:25.198930 21947 raft_consensus.cc:2781] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:51:25.199031 21947 raft_consensus.cc:482] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:51:25.199065 21947 raft_consensus.cc:3037] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:25.200376 21947 raft_consensus.cc:504] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3004d8c477487192293b82be32538f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46755 } } peers { permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 } } peers { permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 } }
I20260806 11:51:25.200781 21947 leader_election.cc:288] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [CANDIDATE]: Term 1 election: Requested vote from peers 37711bba89e447318ccd8676abf22e9d (127.26.172.193:41519), f2abac1eb9ee48a0bc7b34b7055fbca9 (127.26.172.194:33699)
I20260806 11:51:25.201272 21477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d9c63398c9347e6ab1801db00672ffb" candidate_uuid: "1d3004d8c477487192293b82be32538f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37711bba89e447318ccd8676abf22e9d"
I20260806 11:51:25.201418 21477 raft_consensus.cc:3037] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:25.201447 21665 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d9c63398c9347e6ab1801db00672ffb" candidate_uuid: "1d3004d8c477487192293b82be32538f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9"
I20260806 11:51:25.201694 21665 raft_consensus.cc:3037] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:25.202731 21477 raft_consensus.cc:2454] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3004d8c477487192293b82be32538f in term 1.
I20260806 11:51:25.203182 21752 leader_election.cc:302] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3004d8c477487192293b82be32538f, 37711bba89e447318ccd8676abf22e9d; no voters:
I20260806 11:51:25.203277 21665 raft_consensus.cc:2454] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3004d8c477487192293b82be32538f in term 1.
I20260806 11:51:25.203413 21947 raft_consensus.cc:2781] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:25.203732 21947 raft_consensus.cc:686] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 1 LEADER]: Becoming Leader. State: Replica: 1d3004d8c477487192293b82be32538f, State: Running, Role: LEADER
I20260806 11:51:25.204188 21947 consensus_queue.cc:237] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3004d8c477487192293b82be32538f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46755 } } peers { permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 } } peers { permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 } }
W20260806 11:51:25.206007 21544 tablet.cc:2369] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:51:25.208559 21276 catalog_manager.cc:5495] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d3004d8c477487192293b82be32538f (127.26.172.195). New cstate: current_term: 1 leader_uuid: "1d3004d8c477487192293b82be32538f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3004d8c477487192293b82be32538f" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 } health_report { overall_health: UNKNOWN } } }
W20260806 11:51:25.220995 21723 tablet.cc:2369] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:51:25.234488 21931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.230285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34128 (local address 127.26.172.195:46755)
0806 11:51:25.230466 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:25.230472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:25.230491 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:51:25.230614 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:25.230617 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:25.230678 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:25.230811 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:51:25.231154 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.231688 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.232803 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.233025 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.233151 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.233521 (+ 370us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:51:25.234022 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:51:25.234165 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:25.234224 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 11:51:25.234291 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 11:51:25.242347 21477 raft_consensus.cc:1261] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d [term 1 FOLLOWER]: Refusing update from remote peer 1d3004d8c477487192293b82be32538f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:25.242336 21665 raft_consensus.cc:1261] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9 [term 1 FOLLOWER]: Refusing update from remote peer 1d3004d8c477487192293b82be32538f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:25.243227 21947 consensus_queue.cc:1035] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2abac1eb9ee48a0bc7b34b7055fbca9" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 33699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:25.243512 21952 consensus_queue.cc:1035] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37711bba89e447318ccd8676abf22e9d" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 41519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 11:51:25.252871 21915 tablet.cc:2369] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:51:25.254482 21959 mvcc.cc:205] Tried to move back new op lower bound from 7315525981142814720 to 7315525980999356416. Current Snapshot: MvccSnapshot[applied={T|T < 7315525981142814720}]
I20260806 11:51:25.255016 21956 mvcc.cc:205] Tried to move back new op lower bound from 7315525981142814720 to 7315525980999356416. Current Snapshot: MvccSnapshot[applied={T|T < 7315525981142814720}]
I20260806 11:51:25.265600 21277 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:25.265889 21277 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:25.268874 21277 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e48b2c3311e64d8a945357923848fc3b: Sending DeleteTablet for 3 replicas of tablet 6d9c63398c9347e6ab1801db00672ffb
I20260806 11:51:25.269881 21814 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d9c63398c9347e6ab1801db00672ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:25 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:34118
I20260806 11:51:25.269937 21446 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d9c63398c9347e6ab1801db00672ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:25 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:60752
I20260806 11:51:25.270170 21640 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d9c63398c9347e6ab1801db00672ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:25 UTC) from {username='kudu', principal='kudu/127.26.172.254@KRBTEST.COM'} at 127.0.0.1:51946
I20260806 11:51:25.271044 21972 tablet_replica.cc:330] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: stopping tablet replica
I20260806 11:51:25.271044 21970 tablet_replica.cc:330] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: stopping tablet replica
I20260806 11:51:25.271490 21970 raft_consensus.cc:2229] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:51:25.271490 21972 raft_consensus.cc:2229] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:25.271953 21970 raft_consensus.cc:2258] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:25.271993 21972 raft_consensus.cc:2258] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:25.272267 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 21360
I20260806 11:51:25.272341 21968 tablet_replica.cc:330] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d: stopping tablet replica
I20260806 11:51:25.272665 21968 raft_consensus.cc:2229] T 6d9c63398c9347e6ab1801db00672ffb P 37711bba89e447318ccd8676abf22e9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:25.277001 21970 ts_tablet_manager.cc:1905] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:25.281061 21970 ts_tablet_manager.cc:1918] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:25.281196 21970 log.cc:1196] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/6d9c63398c9347e6ab1801db00672ffb
I20260806 11:51:25.281334 21972 ts_tablet_manager.cc:1905] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:25.281594 21970 ts_tablet_manager.cc:1939] T 6d9c63398c9347e6ab1801db00672ffb P 1d3004d8c477487192293b82be32538f: Deleting consensus metadata
I20260806 11:51:25.283049 21259 catalog_manager.cc:4841] TS 1d3004d8c477487192293b82be32538f (127.26.172.195:46755): tablet 6d9c63398c9347e6ab1801db00672ffb (table test-table [id=4d1368d2cf89438485b19c0a7b86a470]) successfully deleted
I20260806 11:51:25.285808 21972 ts_tablet_manager.cc:1918] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:25.285987 21972 log.cc:1196] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/6d9c63398c9347e6ab1801db00672ffb
I20260806 11:51:25.286379 21972 ts_tablet_manager.cc:1939] T 6d9c63398c9347e6ab1801db00672ffb P f2abac1eb9ee48a0bc7b34b7055fbca9: Deleting consensus metadata
I20260806 11:51:25.288359 21258 catalog_manager.cc:4841] TS f2abac1eb9ee48a0bc7b34b7055fbca9 (127.26.172.194:33699): tablet 6d9c63398c9347e6ab1801db00672ffb (table test-table [id=4d1368d2cf89438485b19c0a7b86a470]) successfully deleted
W20260806 11:51:25.289964 21258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:41519 (error 108)
I20260806 11:51:25.290374 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 21548
I20260806 11:51:25.291985 21932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.291546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:41519 (local address 127.0.0.1:60754)
0806 11:51:25.291779 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:25.291875 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:41519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
W20260806 11:51:25.292188 21258 catalog_manager.cc:4584] TS 37711bba89e447318ccd8676abf22e9d (127.26.172.193:41519): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6d9c63398c9347e6ab1801db00672ffb: Network error: Client connection negotiation failed: client connection to 127.26.172.193:41519: connect: Connection refused (error 111)
I20260806 11:51:25.311810 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 21727
I20260806 11:51:25.333992 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 21237
2026-08-06T11:51:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2891 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T11:51:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:25Z Disabled control of system clock
I20260806 11:51:25.382334 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:38849
--webserver_interface=127.26.172.254
--webserver_port=0
--builtin_ntp_servers=127.26.172.212:37117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:38849
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 11:51:25.523960 21979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:25.524324 21979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:25.524365 21979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:25.528558 21979 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:25.528632 21979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:25.528648 21979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:25.528666 21979 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:25.528682 21979 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:25.534103 21979 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:38849
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:38849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:25.535708 21979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:25.537442 21979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:25.548770 21988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:25.548770 21990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:25.548822 21987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:25.549404 21979 server_base.cc:1034] running on GCE node
I20260806 11:51:25.550150 21979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:25.551630 21979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:25.552899 21979 hybrid_clock.cc:648] HybridClock initialized: now 1786017085552869 us; error 50 us; skew 500 ppm
I20260806 11:51:25.555603 21979 webserver.cc:460] Webserver started at http://127.26.172.254:35207/ using document root <none> and password file <none>
I20260806 11:51:25.556427 21979 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:25.556510 21979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:25.556727 21979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:25.559363 21979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "4e8a29b741aa4026ac21b784bf76e04f"
format_stamp: "Formatted at 2026-08-06 11:51:25 on dist-test-slave-7z32"
server_key: "f6ff2a22c9e95b5df2c1fd54feb22268"
server_key_iv: "493c86e3e0d7d9da38f47a18aeeb35f2"
server_key_version: "encryptionkey@0"
I20260806 11:51:25.559970 21979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "4e8a29b741aa4026ac21b784bf76e04f"
format_stamp: "Formatted at 2026-08-06 11:51:25 on dist-test-slave-7z32"
server_key: "f6ff2a22c9e95b5df2c1fd54feb22268"
server_key_iv: "493c86e3e0d7d9da38f47a18aeeb35f2"
server_key_version: "encryptionkey@0"
I20260806 11:51:25.565124 21979 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:51:25.568377 21998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:25.570309 21979 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:25.570556 21979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "4e8a29b741aa4026ac21b784bf76e04f"
format_stamp: "Formatted at 2026-08-06 11:51:25 on dist-test-slave-7z32"
server_key: "f6ff2a22c9e95b5df2c1fd54feb22268"
server_key_iv: "493c86e3e0d7d9da38f47a18aeeb35f2"
server_key_version: "encryptionkey@0"
I20260806 11:51:25.570716 21979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:25.602736 21979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:25.603744 21979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:25.603992 21979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:25.612633 21979 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:38849
I20260806 11:51:25.612742 22069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:38849 every 8 connection(s)
I20260806 11:51:25.613977 21979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:25.618580 22071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:25.623355 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 21979
I20260806 11:51:25.623554 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:25.623943 27315 external_mini_cluster.cc:1428] Setting key dcd50008e3c37177d8ebd77ed4980842
I20260806 11:51:25.627079 22071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f: Bootstrap starting.
I20260806 11:51:25.630174 22071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:25.631214 22071 log.cc:824] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:25.633992 22071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f: No bootstrap required, opened a new log
I20260806 11:51:25.636132 22075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.625925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38418 (local address 127.26.172.254:38849)
0806 11:51:25.627098 (+ 1173us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:25.627122 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:25.627197 (+ 75us) server_negotiation.cc:407] Connection header received
0806 11:51:25.628110 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:25.628135 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:25.628701 (+ 566us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:25.629137 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:25.629651 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.630887 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.631890 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.632419 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.632615 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.633827 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:25.633834 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:25.633855 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:25.634400 (+ 545us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:25.634469 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:25.634494 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:25.634617 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:25.634789 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 11:51:25.635171 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":222,"threads_started":1}
I20260806 11:51:25.639304 22071 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e8a29b741aa4026ac21b784bf76e04f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38849 } }
I20260806 11:51:25.639696 22071 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:25.639791 22071 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e8a29b741aa4026ac21b784bf76e04f, State: Initialized, Role: FOLLOWER
I20260806 11:51:25.640352 22071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e8a29b741aa4026ac21b784bf76e04f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38849 } }
I20260806 11:51:25.640542 22071 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:25.640647 22071 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:25.640786 22071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:25.642103 22071 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e8a29b741aa4026ac21b784bf76e04f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38849 } }
I20260806 11:51:25.642563 22071 leader_election.cc:302] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e8a29b741aa4026ac21b784bf76e04f; no voters:
I20260806 11:51:25.643168 22071 leader_election.cc:288] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:25.643317 22079 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:25.643535 22079 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [term 1 LEADER]: Becoming Leader. State: Replica: 4e8a29b741aa4026ac21b784bf76e04f, State: Running, Role: LEADER
I20260806 11:51:25.644616 22079 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e8a29b741aa4026ac21b784bf76e04f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38849 } }
I20260806 11:51:25.644999 22071 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:25.646790 22080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e8a29b741aa4026ac21b784bf76e04f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e8a29b741aa4026ac21b784bf76e04f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38849 } } }
I20260806 11:51:25.646996 22080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:25.647069 22081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e8a29b741aa4026ac21b784bf76e04f. Latest consensus state: current_term: 1 leader_uuid: "4e8a29b741aa4026ac21b784bf76e04f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e8a29b741aa4026ac21b784bf76e04f" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 38849 } } }
I20260806 11:51:25.647265 22081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f [sys.catalog]: This master's current role is: LEADER
W20260806 11:51:25.651566 22097 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:25.651691 22097 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:25.651768 22093 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:25.652808 22093 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:25.660483 22093 catalog_manager.cc:1347] Generated new cluster ID: 201e0cce12a14f7cbccdb5ab5f6599d3
I20260806 11:51:25.660604 22093 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:25.683063 22093 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:25.684152 22093 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:25.695011 22093 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f: Generated new TSK 0
I20260806 11:51:25.695896 22093 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:25.700515 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.193:0
--local_ip_for_outbound_sockets=127.26.172.193
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:38849
--builtin_ntp_servers=127.26.172.212:37117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 11:51:25.837314 22102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:25.837649 22102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:25.837690 22102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:25.842082 22102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:25.842170 22102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:25.842231 22102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.193
I20260806 11:51:25.847607 22102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.172.193
--webserver_port=0
--tserver_master_addrs=127.26.172.254:38849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.193
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:25.848970 22102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:25.850503 22102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:25.862169 22112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:25.862138 22109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:25.862164 22110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:25.862538 22102 server_base.cc:1034] running on GCE node
I20260806 11:51:25.863302 22102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:25.864293 22102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:25.865536 22102 hybrid_clock.cc:648] HybridClock initialized: now 1786017085865502 us; error 49 us; skew 500 ppm
I20260806 11:51:25.868364 22102 webserver.cc:460] Webserver started at http://127.26.172.193:40479/ using document root <none> and password file <none>
I20260806 11:51:25.869460 22102 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:25.869624 22102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:25.869938 22102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:25.872586 22102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/data/instance:
uuid: "b6944e462f9c4451a770c4ba36326e31"
format_stamp: "Formatted at 2026-08-06 11:51:25 on dist-test-slave-7z32"
server_key: "f95ecb1fc8967c91b69a9ed0723fb7aa"
server_key_iv: "78d8fcc6d9e8f1ac85dadc872f367a96"
server_key_version: "encryptionkey@0"
I20260806 11:51:25.873415 22102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance:
uuid: "b6944e462f9c4451a770c4ba36326e31"
format_stamp: "Formatted at 2026-08-06 11:51:25 on dist-test-slave-7z32"
server_key: "f95ecb1fc8967c91b69a9ed0723fb7aa"
server_key_iv: "78d8fcc6d9e8f1ac85dadc872f367a96"
server_key_version: "encryptionkey@0"
I20260806 11:51:25.878522 22102 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:51:25.882014 22118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:25.883721 22102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 11:51:25.883930 22102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/wal
uuid: "b6944e462f9c4451a770c4ba36326e31"
format_stamp: "Formatted at 2026-08-06 11:51:25 on dist-test-slave-7z32"
server_key: "f95ecb1fc8967c91b69a9ed0723fb7aa"
server_key_iv: "78d8fcc6d9e8f1ac85dadc872f367a96"
server_key_version: "encryptionkey@0"
I20260806 11:51:25.884071 22102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:25.898247 22102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:25.899149 22102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:25.899361 22102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:25.900084 22102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:25.901188 22102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:25.901268 22102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:25.901335 22102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:25.901386 22102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:25.913161 22102 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.193:38717
I20260806 11:51:25.913223 22284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.193:38717 every 8 connection(s)
I20260806 11:51:25.914299 22102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/data/info.pb
I20260806 11:51:25.920527 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 22102
I20260806 11:51:25.920732 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-0/wal/instance
I20260806 11:51:25.921218 27315 external_mini_cluster.cc:1428] Setting key d374e135e2bc56bb9cb0b4fa58159d80
I20260806 11:51:25.924228 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.194:0
--local_ip_for_outbound_sockets=127.26.172.194
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:38849
--builtin_ntp_servers=127.26.172.212:37117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 11:51:25.927692 22075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.917136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:41265 (local address 127.26.172.254:38849)
0806 11:51:25.917411 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:25.917416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:25.918991 (+ 1575us) server_negotiation.cc:407] Connection header received
0806 11:51:25.920647 (+ 1656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:25.920653 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:25.920754 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:25.920916 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:25.922163 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.922947 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.924596 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.925017 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.925178 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.926897 (+ 1719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:25.926908 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:25.926911 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:25.926930 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:25.926957 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:25.926967 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:25.927049 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:25.927377 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 11:51:25.927464 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 11:51:25.929406 22287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:25.917674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:38849 (local address 127.26.172.193:41265)
0806 11:51:25.918709 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:25.918764 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:25.920323 (+ 1559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:25.921128 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:25.921135 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:25.921233 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:25.921943 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.921966 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.923148 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.923151 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.924308 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:25.924321 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:25.925245 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:25.925249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:25.925507 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:25.926415 (+ 908us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:51:25.926417 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:25.926473 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:51:25.926597 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:25.927139 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:25.927155 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:25.927164 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 11:51:25.927347 (+ 183us) client_negotiation.cc:240] Negotiation successful
0806 11:51:25.927821 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":186,"threads_started":1}
I20260806 11:51:25.931447 22285 heartbeater.cc:347] Connected to a master server at 127.26.172.254:38849
I20260806 11:51:25.931959 22285 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:25.932816 22285 heartbeater.cc:511] Master 127.26.172.254:38849 requested a full tablet report, sending...
I20260806 11:51:25.935114 22019 ts_manager.cc:194] Registered new tserver with Master: b6944e462f9c4451a770c4ba36326e31 (127.26.172.193:38717)
I20260806 11:51:25.936563 22019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.193:41265
W20260806 11:51:26.055657 22288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:26.056000 22288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:26.056078 22288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:26.061039 22288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:26.061147 22288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:26.061250 22288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.194
I20260806 11:51:26.070164 22288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.172.194
--webserver_port=0
--tserver_master_addrs=127.26.172.254:38849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.194
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:26.072197 22288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:26.074015 22288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:26.087657 22300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:26.087581 22296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:26.087632 22297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:26.088187 22288 server_base.cc:1034] running on GCE node
I20260806 11:51:26.088869 22288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:26.089725 22288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:26.090977 22288 hybrid_clock.cc:648] HybridClock initialized: now 1786017086090952 us; error 64 us; skew 500 ppm
I20260806 11:51:26.093466 22288 webserver.cc:460] Webserver started at http://127.26.172.194:43261/ using document root <none> and password file <none>
I20260806 11:51:26.094177 22288 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:26.094283 22288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:26.094538 22288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:26.097090 22288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/data/instance:
uuid: "cbc2a9343b4d47ae93b0e006015d7b45"
format_stamp: "Formatted at 2026-08-06 11:51:26 on dist-test-slave-7z32"
server_key: "ff25a4b4942633f062b83f8a1c0f1c36"
server_key_iv: "9d4a81e0571f5ddeb61625dac5abef72"
server_key_version: "encryptionkey@0"
I20260806 11:51:26.097740 22288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance:
uuid: "cbc2a9343b4d47ae93b0e006015d7b45"
format_stamp: "Formatted at 2026-08-06 11:51:26 on dist-test-slave-7z32"
server_key: "ff25a4b4942633f062b83f8a1c0f1c36"
server_key_iv: "9d4a81e0571f5ddeb61625dac5abef72"
server_key_version: "encryptionkey@0"
I20260806 11:51:26.102633 22288 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260806 11:51:26.106182 22307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:26.108233 22288 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:51:26.108448 22288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/wal
uuid: "cbc2a9343b4d47ae93b0e006015d7b45"
format_stamp: "Formatted at 2026-08-06 11:51:26 on dist-test-slave-7z32"
server_key: "ff25a4b4942633f062b83f8a1c0f1c36"
server_key_iv: "9d4a81e0571f5ddeb61625dac5abef72"
server_key_version: "encryptionkey@0"
I20260806 11:51:26.108616 22288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:26.126732 22288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:26.127586 22288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:26.127821 22288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:26.128530 22288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:26.129707 22288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:26.129791 22288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:26.129871 22288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:26.129920 22288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:26.142796 22288 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.194:35407
I20260806 11:51:26.143002 22466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.194:35407 every 8 connection(s)
I20260806 11:51:26.144044 22288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/data/info.pb
I20260806 11:51:26.147007 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 22288
I20260806 11:51:26.147194 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/wal/instance
I20260806 11:51:26.147708 27315 external_mini_cluster.cc:1428] Setting key d50f8e9ebe0c19da489215a03625361c
I20260806 11:51:26.150924 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.172.195:0
--local_ip_for_outbound_sockets=127.26.172.195
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:38849
--builtin_ntp_servers=127.26.172.212:37117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 11:51:26.159533 22075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.146848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.194:38015 (local address 127.26.172.254:38849)
0806 11:51:26.147053 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:26.147059 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:26.148885 (+ 1826us) server_negotiation.cc:407] Connection header received
0806 11:51:26.151330 (+ 2445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:26.151333 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:26.151433 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:26.151543 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:26.153400 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.154455 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.156194 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.156631 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.156791 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.158679 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:26.158686 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:26.158692 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:26.158720 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:26.158757 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:26.158773 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:26.158923 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:26.159154 (+ 231us) server_negotiation.cc:299] Negotiation successful
0806 11:51:26.159272 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 11:51:26.160732 22469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.147497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:38849 (local address 127.26.172.194:38015)
0806 11:51:26.148573 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:26.148669 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:26.150960 (+ 2291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:26.151891 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:26.151908 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:26.152081 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:26.153119 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.153148 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.154696 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.154699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.156022 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.156035 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.156903 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.156907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.157137 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.158252 (+ 1115us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:51:26.158263 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:26.158325 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:51:26.158432 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:26.158951 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:26.158961 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:26.158968 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 11:51:26.159116 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 11:51:26.159462 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":125,"threads_started":1}
I20260806 11:51:26.162410 22467 heartbeater.cc:347] Connected to a master server at 127.26.172.254:38849
I20260806 11:51:26.162807 22467 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:26.163658 22467 heartbeater.cc:511] Master 127.26.172.254:38849 requested a full tablet report, sending...
I20260806 11:51:26.165202 22019 ts_manager.cc:194] Registered new tserver with Master: cbc2a9343b4d47ae93b0e006015d7b45 (127.26.172.194:35407)
I20260806 11:51:26.166184 22019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.194:38015
W20260806 11:51:26.278594 22470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:26.278967 22470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:26.279012 22470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:26.283275 22470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:26.283354 22470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:26.283413 22470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.172.195
I20260806 11:51:26.288393 22470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.172.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.172.195
--webserver_port=0
--tserver_master_addrs=127.26.172.254:38849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.172.195
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:26.289685 22470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:26.291266 22470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:26.301851 22480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:26.301894 22482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:26.301895 22477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:26.302419 22470 server_base.cc:1034] running on GCE node
I20260806 11:51:26.303186 22470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:26.304190 22470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:26.305434 22470 hybrid_clock.cc:648] HybridClock initialized: now 1786017086305395 us; error 54 us; skew 500 ppm
I20260806 11:51:26.308493 22470 webserver.cc:460] Webserver started at http://127.26.172.195:37713/ using document root <none> and password file <none>
I20260806 11:51:26.309331 22470 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:26.309458 22470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:26.309770 22470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:26.312839 22470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/data/instance:
uuid: "f09211e8601d4754828271426f938832"
format_stamp: "Formatted at 2026-08-06 11:51:26 on dist-test-slave-7z32"
server_key: "06a2fd15c643626c53e41acfd7a2a194"
server_key_iv: "3176d7e6a4587aa952e4910439758ef9"
server_key_version: "encryptionkey@0"
I20260806 11:51:26.313637 22470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance:
uuid: "f09211e8601d4754828271426f938832"
format_stamp: "Formatted at 2026-08-06 11:51:26 on dist-test-slave-7z32"
server_key: "06a2fd15c643626c53e41acfd7a2a194"
server_key_iv: "3176d7e6a4587aa952e4910439758ef9"
server_key_version: "encryptionkey@0"
I20260806 11:51:26.319072 22470 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 11:51:26.322674 22500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:26.324644 22470 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:51:26.324859 22470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/wal
uuid: "f09211e8601d4754828271426f938832"
format_stamp: "Formatted at 2026-08-06 11:51:26 on dist-test-slave-7z32"
server_key: "06a2fd15c643626c53e41acfd7a2a194"
server_key_iv: "3176d7e6a4587aa952e4910439758ef9"
server_key_version: "encryptionkey@0"
I20260806 11:51:26.325032 22470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:26.361086 22470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:26.362103 22470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:26.362362 22470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:26.363215 22470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 11:51:26.364475 22470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 11:51:26.364566 22470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:26.364647 22470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 11:51:26.364683 22470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:26.377233 22470 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.195:41109
I20260806 11:51:26.377315 22660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.195:41109 every 8 connection(s)
I20260806 11:51:26.378441 22470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/data/info.pb
I20260806 11:51:26.382169 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 22470
I20260806 11:51:26.382330 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/wal/instance
I20260806 11:51:26.382679 27315 external_mini_cluster.cc:1428] Setting key 2c88d73fec69484679ce30e5fd888bbe
I20260806 11:51:26.390282 22075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.380902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.195:37813 (local address 127.26.172.254:38849)
0806 11:51:26.381098 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:26.381104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:26.382360 (+ 1256us) server_negotiation.cc:407] Connection header received
0806 11:51:26.384510 (+ 2150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:26.384514 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:26.384591 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:26.384701 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:26.385880 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.386472 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.387882 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.388116 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.388247 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.389713 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:26.389716 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:26.389719 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:26.389732 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:26.389755 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:26.389763 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:26.389829 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:26.390055 (+ 226us) server_negotiation.cc:299] Negotiation successful
0806 11:51:26.390122 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 11:51:26.391314 22665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.381282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:38849 (local address 127.26.172.195:37813)
0806 11:51:26.382141 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:26.382194 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:26.384240 (+ 2046us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:26.384945 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:26.384957 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:26.385107 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:51:26.385732 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.385747 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.386616 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.386620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.387754 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.387766 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.388364 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.388378 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.388601 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.389408 (+ 807us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 11:51:26.389410 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:51:26.389457 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 11:51:26.389541 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:51:26.389852 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:51:26.389860 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:51:26.389864 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 11:51:26.389989 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 11:51:26.390265 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":141,"threads_started":1}
I20260806 11:51:26.392956 22661 heartbeater.cc:347] Connected to a master server at 127.26.172.254:38849
I20260806 11:51:26.393288 22661 heartbeater.cc:464] Registering TS with master...
I20260806 11:51:26.394001 22661 heartbeater.cc:511] Master 127.26.172.254:38849 requested a full tablet report, sending...
I20260806 11:51:26.395569 22019 ts_manager.cc:194] Registered new tserver with Master: f09211e8601d4754828271426f938832 (127.26.172.195:41109)
I20260806 11:51:26.396294 22019 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.172.195:37813
I20260806 11:51:26.397869 27315 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 11:51:26.405085 22075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.400639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38430 (local address 127.26.172.254:38849)
0806 11:51:26.400831 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:26.400836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:26.401080 (+ 244us) server_negotiation.cc:407] Connection header received
0806 11:51:26.401204 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:26.401207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:26.401260 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:26.401329 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:26.401659 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.402239 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.403309 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.403535 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.403620 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.404520 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:26.404523 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:26.404526 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:26.404539 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:26.404560 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:26.404568 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:26.404632 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:26.404774 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 11:51:26.404868 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 11:51:26.409279 22019 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38430:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 11:51:26.413194 22019 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 11:51:26.434571 22679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.427011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:41109 (local address 127.0.0.1:43464)
0806 11:51:26.427812 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:26.427828 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:26.428070 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:26.428768 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:26.428776 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:26.428803 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:26.428990 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.428998 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.430694 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.430698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.432666 (+ 1968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.432681 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.433819 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.433823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.433979 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.434026 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 11:51:26.434175 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 11:51:26.434301 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"mutex_wait_us":117,"thread_start_us":178,"threads_started":1}
I20260806 11:51:26.434582 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.427277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43464 (local address 127.26.172.195:41109)
0806 11:51:26.427684 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:26.427702 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:26.427970 (+ 268us) server_negotiation.cc:407] Connection header received
0806 11:51:26.428319 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:26.428326 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:26.428569 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:26.428773 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:26.429146 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.430559 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.432842 (+ 2283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.433643 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.433812 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.434067 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:26.434210 (+ 143us) server_negotiation.cc:299] Negotiation successful
0806 11:51:26.434356 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":193,"threads_started":1}
I20260806 11:51:26.435055 22686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.427993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47652 (local address 127.26.172.194:35407)
0806 11:51:26.428507 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:26.428522 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:26.428549 (+ 27us) server_negotiation.cc:407] Connection header received
0806 11:51:26.428644 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:26.428650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:26.428848 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:26.429012 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:26.429736 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.431020 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.432372 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.434288 (+ 1916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.434435 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.434645 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:26.434717 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 11:51:26.434872 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":194,"threads_started":1}
I20260806 11:51:26.434985 22685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.427353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35407 (local address 127.0.0.1:47652)
0806 11:51:26.427877 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:26.427896 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:26.428022 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:26.428990 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:26.428993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:26.429010 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:26.429208 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.429219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.431173 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.431177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.432202 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.432214 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.434451 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.434455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.434569 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.434608 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 11:51:26.434693 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 11:51:26.434799 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":118,"thread_start_us":173,"threads_started":1}
I20260806 11:51:26.435806 22683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.426066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:38717 (local address 127.0.0.1:60678)
0806 11:51:26.427638 (+ 1572us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:26.427724 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:26.427931 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:26.429090 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:26.429094 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:26.429114 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:26.429324 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.429349 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.431220 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.431224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.432725 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.432738 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.435331 (+ 2593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.435348 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.435472 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.435505 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 11:51:26.435587 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 11:51:26.435668 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1270,"mutex_wait_us":149,"thread_start_us":133,"threads_started":1}
I20260806 11:51:26.436305 22681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.426352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60678 (local address 127.26.172.193:38717)
0806 11:51:26.426947 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:26.426957 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:26.428156 (+ 1199us) server_negotiation.cc:407] Connection header received
0806 11:51:26.428277 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:26.428287 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:26.428675 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:26.428863 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:26.429515 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.431099 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.432896 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.433637 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.433819 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.434066 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:26.436025 (+ 1959us) server_negotiation.cc:299] Negotiation successful
0806 11:51:26.436166 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":203,"threads_started":1}
I20260806 11:51:26.439540 22569 tablet_service.cc:1467] Processing CreateTablet for tablet 8ba6741bb1e048ff8f37f3ce822353d0 (DEFAULT_TABLE table=test-table [id=f2f6bf5b1ecb43b9a967f7dcc463bff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:26.440160 22186 tablet_service.cc:1467] Processing CreateTablet for tablet 8ba6741bb1e048ff8f37f3ce822353d0 (DEFAULT_TABLE table=test-table [id=f2f6bf5b1ecb43b9a967f7dcc463bff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:26.441166 22569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ba6741bb1e048ff8f37f3ce822353d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:26.441278 22186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ba6741bb1e048ff8f37f3ce822353d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:26.441097 22383 tablet_service.cc:1467] Processing CreateTablet for tablet 8ba6741bb1e048ff8f37f3ce822353d0 (DEFAULT_TABLE table=test-table [id=f2f6bf5b1ecb43b9a967f7dcc463bff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 11:51:26.442242 22383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ba6741bb1e048ff8f37f3ce822353d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:26.448760 22687 tablet_bootstrap.cc:492] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31: Bootstrap starting.
I20260806 11:51:26.450788 22689 tablet_bootstrap.cc:492] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: Bootstrap starting.
I20260806 11:51:26.451751 22691 tablet_bootstrap.cc:492] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: Bootstrap starting.
I20260806 11:51:26.452191 22687 tablet_bootstrap.cc:654] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:26.453190 22687 log.cc:824] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:26.453421 22689 tablet_bootstrap.cc:654] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:26.454460 22689 log.cc:824] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:26.454535 22691 tablet_bootstrap.cc:654] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:26.455426 22691 log.cc:824] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:26.455996 22687 tablet_bootstrap.cc:492] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31: No bootstrap required, opened a new log
I20260806 11:51:26.456225 22687 ts_tablet_manager.cc:1397] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260806 11:51:26.456801 22689 tablet_bootstrap.cc:492] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: No bootstrap required, opened a new log
I20260806 11:51:26.457032 22689 ts_tablet_manager.cc:1397] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260806 11:51:26.458213 22691 tablet_bootstrap.cc:492] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: No bootstrap required, opened a new log
I20260806 11:51:26.458498 22691 ts_tablet_manager.cc:1397] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260806 11:51:26.460404 22687 raft_consensus.cc:348] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6944e462f9c4451a770c4ba36326e31" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 38717 } } peers { permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 } } peers { permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 } }
I20260806 11:51:26.460714 22687 raft_consensus.cc:374] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:26.460776 22687 raft_consensus.cc:729] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6944e462f9c4451a770c4ba36326e31, State: Initialized, Role: FOLLOWER
I20260806 11:51:26.461465 22687 consensus_queue.cc:260] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6944e462f9c4451a770c4ba36326e31" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 38717 } } peers { permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 } } peers { permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 } }
I20260806 11:51:26.462386 22285 heartbeater.cc:503] Master 127.26.172.254:38849 was elected leader, sending a full tablet report...
I20260806 11:51:26.462260 22689 raft_consensus.cc:348] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6944e462f9c4451a770c4ba36326e31" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 38717 } } peers { permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 } } peers { permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 } }
I20260806 11:51:26.462589 22689 raft_consensus.cc:374] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:26.462652 22689 raft_consensus.cc:729] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f09211e8601d4754828271426f938832, State: Initialized, Role: FOLLOWER
I20260806 11:51:26.462780 22687 ts_tablet_manager.cc:1428] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260806 11:51:26.463261 22689 consensus_queue.cc:260] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6944e462f9c4451a770c4ba36326e31" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 38717 } } peers { permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 } } peers { permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 } }
I20260806 11:51:26.464272 22691 raft_consensus.cc:348] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6944e462f9c4451a770c4ba36326e31" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 38717 } } peers { permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 } } peers { permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 } }
I20260806 11:51:26.464504 22689 ts_tablet_manager.cc:1428] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260806 11:51:26.464954 22661 heartbeater.cc:503] Master 127.26.172.254:38849 was elected leader, sending a full tablet report...
I20260806 11:51:26.464582 22691 raft_consensus.cc:374] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:26.465265 22691 raft_consensus.cc:729] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbc2a9343b4d47ae93b0e006015d7b45, State: Initialized, Role: FOLLOWER
I20260806 11:51:26.465806 22691 consensus_queue.cc:260] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6944e462f9c4451a770c4ba36326e31" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 38717 } } peers { permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 } } peers { permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 } }
I20260806 11:51:26.466609 22467 heartbeater.cc:503] Master 127.26.172.254:38849 was elected leader, sending a full tablet report...
I20260806 11:51:26.467027 22691 ts_tablet_manager.cc:1428] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: Time spent starting tablet: real 0.008s user 0.001s sys 0.006s
I20260806 11:51:26.595381 22695 raft_consensus.cc:482] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 11:51:26.595635 22695 raft_consensus.cc:504] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6944e462f9c4451a770c4ba36326e31" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 38717 } } peers { permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 } } peers { permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 } }
I20260806 11:51:26.596969 22695 leader_election.cc:288] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f09211e8601d4754828271426f938832 (127.26.172.195:41109), cbc2a9343b4d47ae93b0e006015d7b45 (127.26.172.194:35407)
I20260806 11:51:26.602129 22686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.597725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:48371 (local address 127.26.172.194:35407)
0806 11:51:26.597948 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:26.597953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:26.598234 (+ 281us) server_negotiation.cc:407] Connection header received
0806 11:51:26.598415 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:26.598418 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:26.598478 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:26.598572 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:26.599069 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.599634 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.601014 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.601433 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.601563 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.601658 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:26.601861 (+ 203us) server_negotiation.cc:299] Negotiation successful
0806 11:51:26.601976 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 11:51:26.602224 22700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.597216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.195:41109 (local address 127.26.172.193:51715)
0806 11:51:26.597655 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:26.597674 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:26.597835 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:26.598414 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:26.598417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:26.598442 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:26.598612 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.598620 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.599790 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.599796 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.600869 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.600881 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.601696 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.601700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.601837 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.601872 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 11:51:26.601961 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 11:51:26.602052 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":80,"thread_start_us":176,"threads_started":1}
I20260806 11:51:26.602254 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.597382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.172.193:51715 (local address 127.26.172.195:41109)
0806 11:51:26.597675 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:26.597682 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:26.597770 (+ 88us) server_negotiation.cc:407] Connection header received
0806 11:51:26.597991 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:26.597995 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:26.598085 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:26.598146 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 11:51:26.598869 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.599611 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.601066 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.601522 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.601668 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.601734 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:26.602006 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 11:51:26.602096 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202}
I20260806 11:51:26.602135 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.597599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.194:35407 (local address 127.26.172.193:48371)
0806 11:51:26.598106 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:26.598127 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 11:51:26.598291 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:51:26.598608 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:51:26.598610 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:51:26.598626 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 11:51:26.598889 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.598899 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.599815 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.599818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.600850 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:51:26.600861 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.601589 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.601595 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:51:26.601698 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.601726 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 11:51:26.601812 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 11:51:26.601886 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":6,"thread_start_us":207,"threads_started":1}
I20260806 11:51:26.603384 22593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ba6741bb1e048ff8f37f3ce822353d0" candidate_uuid: "b6944e462f9c4451a770c4ba36326e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f09211e8601d4754828271426f938832" is_pre_election: true
I20260806 11:51:26.603580 22407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ba6741bb1e048ff8f37f3ce822353d0" candidate_uuid: "b6944e462f9c4451a770c4ba36326e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" is_pre_election: true
I20260806 11:51:26.603878 22593 raft_consensus.cc:2454] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6944e462f9c4451a770c4ba36326e31 in term 0.
I20260806 11:51:26.603878 22407 raft_consensus.cc:2454] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6944e462f9c4451a770c4ba36326e31 in term 0.
I20260806 11:51:26.604631 22122 leader_election.cc:302] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b6944e462f9c4451a770c4ba36326e31, cbc2a9343b4d47ae93b0e006015d7b45, f09211e8601d4754828271426f938832; no voters:
I20260806 11:51:26.605108 22695 raft_consensus.cc:2781] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 11:51:26.605252 22695 raft_consensus.cc:482] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 11:51:26.605451 22695 raft_consensus.cc:3037] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:26.606724 22695 raft_consensus.cc:504] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6944e462f9c4451a770c4ba36326e31" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 38717 } } peers { permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 } } peers { permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 } }
I20260806 11:51:26.607288 22695 leader_election.cc:288] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [CANDIDATE]: Term 1 election: Requested vote from peers f09211e8601d4754828271426f938832 (127.26.172.195:41109), cbc2a9343b4d47ae93b0e006015d7b45 (127.26.172.194:35407)
I20260806 11:51:26.607865 22407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ba6741bb1e048ff8f37f3ce822353d0" candidate_uuid: "b6944e462f9c4451a770c4ba36326e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbc2a9343b4d47ae93b0e006015d7b45"
I20260806 11:51:26.608017 22593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ba6741bb1e048ff8f37f3ce822353d0" candidate_uuid: "b6944e462f9c4451a770c4ba36326e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f09211e8601d4754828271426f938832"
I20260806 11:51:26.608028 22407 raft_consensus.cc:3037] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:26.608239 22593 raft_consensus.cc:3037] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:26.609612 22407 raft_consensus.cc:2454] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6944e462f9c4451a770c4ba36326e31 in term 1.
I20260806 11:51:26.609623 22593 raft_consensus.cc:2454] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6944e462f9c4451a770c4ba36326e31 in term 1.
I20260806 11:51:26.610157 22121 leader_election.cc:302] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b6944e462f9c4451a770c4ba36326e31, cbc2a9343b4d47ae93b0e006015d7b45, f09211e8601d4754828271426f938832; no voters:
I20260806 11:51:26.610384 22695 raft_consensus.cc:2781] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:26.610702 22695 raft_consensus.cc:686] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 1 LEADER]: Becoming Leader. State: Replica: b6944e462f9c4451a770c4ba36326e31, State: Running, Role: LEADER
I20260806 11:51:26.611186 22695 consensus_queue.cc:237] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6944e462f9c4451a770c4ba36326e31" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 38717 } } peers { permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 } } peers { permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 } }
I20260806 11:51:26.615289 22018 catalog_manager.cc:5495] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to b6944e462f9c4451a770c4ba36326e31 (127.26.172.193). New cstate: current_term: 1 leader_uuid: "b6944e462f9c4451a770c4ba36326e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6944e462f9c4451a770c4ba36326e31" member_type: VOTER last_known_addr { host: "127.26.172.193" port: 38717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 } health_report { overall_health: UNKNOWN } } }
W20260806 11:51:26.629757 22664 tablet.cc:2369] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:51:26.645726 22468 tablet.cc:2369] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 11:51:26.666072 22286 tablet.cc:2369] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:51:26.676644 22681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.671814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60680 (local address 127.26.172.193:38717)
0806 11:51:26.671970 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:26.671974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:26.671992 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:51:26.672112 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:26.672114 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:26.672175 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:26.672293 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:51:26.672693 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.673303 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.674380 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:26.674616 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:26.674713 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:26.675419 (+ 706us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:51:26.676121 (+ 702us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:51:26.676307 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:26.676352 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 11:51:26.676436 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 11:51:26.684782 22593 raft_consensus.cc:1261] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832 [term 1 FOLLOWER]: Refusing update from remote peer b6944e462f9c4451a770c4ba36326e31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:26.684844 22407 raft_consensus.cc:1261] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45 [term 1 FOLLOWER]: Refusing update from remote peer b6944e462f9c4451a770c4ba36326e31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:51:26.685832 22695 consensus_queue.cc:1035] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f09211e8601d4754828271426f938832" member_type: VOTER last_known_addr { host: "127.26.172.195" port: 41109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:26.686105 22702 consensus_queue.cc:1035] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbc2a9343b4d47ae93b0e006015d7b45" member_type: VOTER last_known_addr { host: "127.26.172.194" port: 35407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:51:26.698206 22709 mvcc.cc:205] Tried to move back new op lower bound from 7315525987050598400 to 7315525986762563584. Current Snapshot: MvccSnapshot[applied={T|T < 7315525987050598400}]
I20260806 11:51:26.709576 22018 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:26.709839 22018 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 11:51:26.713459 22018 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4e8a29b741aa4026ac21b784bf76e04f: Sending DeleteTablet for 3 replicas of tablet 8ba6741bb1e048ff8f37f3ce822353d0
I20260806 11:51:26.714668 22186 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ba6741bb1e048ff8f37f3ce822353d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:26 UTC) from {username='slave'} at 127.0.0.1:60678
I20260806 11:51:26.714766 22383 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ba6741bb1e048ff8f37f3ce822353d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:26 UTC) from {username='slave'} at 127.0.0.1:47652
I20260806 11:51:26.714928 22569 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ba6741bb1e048ff8f37f3ce822353d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 11:51:26 UTC) from {username='slave'} at 127.0.0.1:43464
I20260806 11:51:26.715328 22727 tablet_replica.cc:330] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31: stopping tablet replica
I20260806 11:51:26.715710 22727 raft_consensus.cc:2229] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 1 LEADER]: Raft consensus shutting down.
I20260806 11:51:26.715770 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 22102
I20260806 11:51:26.716244 22727 raft_consensus.cc:2258] T 8ba6741bb1e048ff8f37f3ce822353d0 P b6944e462f9c4451a770c4ba36326e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:26.722272 22729 tablet_replica.cc:330] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: stopping tablet replica
I20260806 11:51:26.722843 22729 raft_consensus.cc:2229] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:26.723193 22728 tablet_replica.cc:330] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: stopping tablet replica
I20260806 11:51:26.723261 22729 raft_consensus.cc:2258] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:26.723551 22728 raft_consensus.cc:2229] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 11:51:26.723872 22728 raft_consensus.cc:2258] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 11:51:26.726656 22728 ts_tablet_manager.cc:1905] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:26.727051 22729 ts_tablet_manager.cc:1905] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 11:51:26.730196 22728 ts_tablet_manager.cc:1918] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:26.730365 22728 log.cc:1196] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-1/wal/wals/8ba6741bb1e048ff8f37f3ce822353d0
I20260806 11:51:26.730765 22728 ts_tablet_manager.cc:1939] T 8ba6741bb1e048ff8f37f3ce822353d0 P cbc2a9343b4d47ae93b0e006015d7b45: Deleting consensus metadata
I20260806 11:51:26.731048 22729 ts_tablet_manager.cc:1918] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 11:51:26.731199 22729 log.cc:1196] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: Deleting WAL directory at /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786016786541679-27315-0/minicluster-data/ts-2/wal/wals/8ba6741bb1e048ff8f37f3ce822353d0
I20260806 11:51:26.731588 22729 ts_tablet_manager.cc:1939] T 8ba6741bb1e048ff8f37f3ce822353d0 P f09211e8601d4754828271426f938832: Deleting consensus metadata
I20260806 11:51:26.732798 22000 catalog_manager.cc:4841] TS cbc2a9343b4d47ae93b0e006015d7b45 (127.26.172.194:35407): tablet 8ba6741bb1e048ff8f37f3ce822353d0 (table test-table [id=f2f6bf5b1ecb43b9a967f7dcc463bff6]) successfully deleted
I20260806 11:51:26.733220 22003 catalog_manager.cc:4841] TS f09211e8601d4754828271426f938832 (127.26.172.195:41109): tablet 8ba6741bb1e048ff8f37f3ce822353d0 (table test-table [id=f2f6bf5b1ecb43b9a967f7dcc463bff6]) successfully deleted
W20260806 11:51:26.734273 22003 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.172.193:38717 (error 108)
I20260806 11:51:26.735337 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 22288
I20260806 11:51:26.735908 22685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:26.735457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.193:38717 (local address 127.0.0.1:60688)
0806 11:51:26.735684 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 11:51:26.735762 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.193:38717: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
W20260806 11:51:26.739315 22003 catalog_manager.cc:4584] TS b6944e462f9c4451a770c4ba36326e31 (127.26.172.193:38717): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8ba6741bb1e048ff8f37f3ce822353d0: Network error: Client connection negotiation failed: client connection to 127.26.172.193:38717: connect: Connection refused (error 111)
I20260806 11:51:26.759367 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 22470
I20260806 11:51:26.773474 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 21979
2026-08-06T11:51:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1439 ms)
[----------] 6 tests from EncryptionPolicyTest (13586 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:26 dist-test-slave-7z32 krb5kdc[22734](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:26 dist-test-slave-7z32 krb5kdc[22734](info): set up 2 sockets
Aug 06 11:51:26 dist-test-slave-7z32 krb5kdc[22734](info): commencing operation
krb5kdc: starting...
W20260806 11:51:28.067299 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.003s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:28 dist-test-slave-7z32 krb5kdc[22734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:28.231805 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46525
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:28.368485 22757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:28.368831 22757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:28.368880 22757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:28.373116 22757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:28.373202 22757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:28.373224 22757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:28.373241 22757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:28.373257 22757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:28.379181 22757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46525
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:28.380766 22757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:28.382095 22757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:28.392576 22765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:28.392576 22766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:28.393162 22757 server_base.cc:1034] running on GCE node
W20260806 11:51:28.392613 22769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:28.393931 22757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:28.395377 22757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:28.396574 22757 hybrid_clock.cc:648] HybridClock initialized: now 1786017088396532 us; error 54 us; skew 500 ppm
Aug 06 11:51:28 dist-test-slave-7z32 krb5kdc[22734](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017088, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:28.400053 22757 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:28.401254 22757 webserver.cc:460] Webserver started at http://127.0.0.1:45043/ using document root <none> and password file <none>
I20260806 11:51:28.401991 22757 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:28.402097 22757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:28.402369 22757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:28.404879 22757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "da9ffef6c831449080588b8b015d0a89"
format_stamp: "Formatted at 2026-08-06 11:51:28 on dist-test-slave-7z32"
server_key: "182120c3edfa32508069be5d0f61adc8"
server_key_iv: "d211d17392c0d9cee2a1141e79107c0d"
server_key_version: "encryptionkey@0"
I20260806 11:51:28.405525 22757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "da9ffef6c831449080588b8b015d0a89"
format_stamp: "Formatted at 2026-08-06 11:51:28 on dist-test-slave-7z32"
server_key: "182120c3edfa32508069be5d0f61adc8"
server_key_iv: "d211d17392c0d9cee2a1141e79107c0d"
server_key_version: "encryptionkey@0"
I20260806 11:51:28.411726 22757 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.007s
I20260806 11:51:28.415938 22778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:28.417784 22757 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:28.418011 22757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "da9ffef6c831449080588b8b015d0a89"
format_stamp: "Formatted at 2026-08-06 11:51:28 on dist-test-slave-7z32"
server_key: "182120c3edfa32508069be5d0f61adc8"
server_key_iv: "d211d17392c0d9cee2a1141e79107c0d"
server_key_version: "encryptionkey@0"
I20260806 11:51:28.418196 22757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:28.435468 22757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:28.439639 22757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:28.439913 22757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:28.449047 22757 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46525
I20260806 11:51:28.449105 22851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46525 every 8 connection(s)
I20260806 11:51:28.450300 22757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:28.452768 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 22757
I20260806 11:51:28.452961 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:28.453367 27315 external_mini_cluster.cc:1428] Setting key 320b0ae9c7d0187aaa439477254b87e2
I20260806 11:51:28.454236 22853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:28.462492 22853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89: Bootstrap starting.
Aug 06 11:51:28 dist-test-slave-7z32 krb5kdc[22734](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 11:51:28.465339 22853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:28.466202 22853 log.cc:824] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:28.468469 22853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89: No bootstrap required, opened a new log
I20260806 11:51:28.471472 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:28.455217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37347 (local address 127.0.0.1:46525)
0806 11:51:28.455834 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:28.455855 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:28.455904 (+ 49us) server_negotiation.cc:407] Connection header received
0806 11:51:28.456756 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:28.456777 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:28.457235 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:28.457600 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:28.458781 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:28.460007 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:28.461326 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:28.461885 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:28.462025 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:28.465699 (+ 3674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:28.465705 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:28.465725 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:28.465760 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:28.467923 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:28.468544 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:28.468552 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:28.468563 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:28.468708 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:28.469070 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:28.469073 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:28.469075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:28.469569 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:28.469826 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:28.470148 (+ 322us) server_negotiation.cc:299] Negotiation successful
0806 11:51:28.470428 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":201,"threads_started":1}
I20260806 11:51:28.472664 22853 raft_consensus.cc:348] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9ffef6c831449080588b8b015d0a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46525 } }
I20260806 11:51:28.472942 22853 raft_consensus.cc:374] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:28.473027 22853 raft_consensus.cc:729] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da9ffef6c831449080588b8b015d0a89, State: Initialized, Role: FOLLOWER
I20260806 11:51:28.473564 22853 consensus_queue.cc:260] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9ffef6c831449080588b8b015d0a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46525 } }
I20260806 11:51:28.473743 22853 raft_consensus.cc:388] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:28.473870 22853 raft_consensus.cc:482] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:28.473976 22853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:28.475214 22853 raft_consensus.cc:504] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9ffef6c831449080588b8b015d0a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46525 } }
I20260806 11:51:28.475461 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:28.475636 22853 leader_election.cc:302] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da9ffef6c831449080588b8b015d0a89; no voters:
I20260806 11:51:28.476035 22853 leader_election.cc:288] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:28.476205 22862 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:28.476554 22862 raft_consensus.cc:686] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [term 1 LEADER]: Becoming Leader. State: Replica: da9ffef6c831449080588b8b015d0a89, State: Running, Role: LEADER
I20260806 11:51:28.476962 22862 consensus_queue.cc:237] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9ffef6c831449080588b8b015d0a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46525 } }
I20260806 11:51:28.477648 22853 sys_catalog.cc:564] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:28.478504 22862 sys_catalog.cc:455] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da9ffef6c831449080588b8b015d0a89. Latest consensus state: current_term: 1 leader_uuid: "da9ffef6c831449080588b8b015d0a89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9ffef6c831449080588b8b015d0a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46525 } } }
I20260806 11:51:28.478641 22862 sys_catalog.cc:458] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:28.479100 22865 sys_catalog.cc:455] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da9ffef6c831449080588b8b015d0a89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da9ffef6c831449080588b8b015d0a89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46525 } } }
I20260806 11:51:28.479207 22865 sys_catalog.cc:458] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89 [sys.catalog]: This master's current role is: LEADER
W20260806 11:51:28.484071 22890 catalog_manager.cc:1558] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:28.484169 22890 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:28.484251 22877 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:28.485244 22877 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:28.488665 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:28.478158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54603 (local address 127.0.0.1:46525)
0806 11:51:28.478328 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:28.478333 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:28.478954 (+ 621us) server_negotiation.cc:407] Connection header received
0806 11:51:28.479191 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:28.479197 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:28.479259 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:28.479328 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:28.480437 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:28.481213 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:28.482382 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:28.482746 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:28.482829 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:28.484687 (+ 1858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:28.484691 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:28.484693 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:28.484719 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:28.486367 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:28.486915 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:28.486919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:28.486921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:28.487010 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:28.487377 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:28.487381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:28.487382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:28.487631 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:28.487803 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:28.488382 (+ 579us) server_negotiation.cc:299] Negotiation successful
0806 11:51:28.488500 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 11:51:28.492825 22877 catalog_manager.cc:1347] Generated new cluster ID: 7e7c9947a3724caea8e9f8c899ca48aa
I20260806 11:51:28.492921 22877 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:28.537417 22877 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:28.538882 22877 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:28.546871 22877 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da9ffef6c831449080588b8b015d0a89: Generated new TSK 0
I20260806 11:51:28.547891 22877 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:28.561786 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 22757
W20260806 11:51:28.579284 22731 connection.cc:535] client connection to 127.0.0.1:46525 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46525): Connection reset by peer (error 104)
2026-08-06T11:51:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1787 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:28 dist-test-slave-7z32 krb5kdc[22899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:28 dist-test-slave-7z32 krb5kdc[22899](info): set up 2 sockets
Aug 06 11:51:28 dist-test-slave-7z32 krb5kdc[22899](info): commencing operation
krb5kdc: starting...
W20260806 11:51:29.870329 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.003s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:29 dist-test-slave-7z32 krb5kdc[22899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017089, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:30.035830 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45785
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:30.181906 22917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:30.182376 22917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:30.182468 22917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:30.187286 22917 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:30.187413 22917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:30.187453 22917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:30.187510 22917 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:30.187567 22917 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:30.194267 22917 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45785
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:30.195963 22917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:30.197347 22917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:30.208954 22926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:30.208961 22928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:30.209022 22924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:30.209034 22917 server_base.cc:1034] running on GCE node
I20260806 11:51:30.210183 22917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:30.211839 22917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:30.213224 22917 hybrid_clock.cc:648] HybridClock initialized: now 1786017090213174 us; error 64 us; skew 500 ppm
Aug 06 11:51:30 dist-test-slave-7z32 krb5kdc[22899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017090, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:30.222143 22917 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:30.223423 22917 webserver.cc:460] Webserver started at http://127.0.0.1:43971/ using document root <none> and password file <none>
I20260806 11:51:30.224125 22917 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:30.224200 22917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:30.224448 22917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:30.226778 22917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "f3bd82c80a9248589b34d681606a05dd"
format_stamp: "Formatted at 2026-08-06 11:51:30 on dist-test-slave-7z32"
server_key: "eab9347a68f66b00210f2bb28d7163a2"
server_key_iv: "c901dd9b9b121d0f8b015cbb77aab750"
server_key_version: "encryptionkey@0"
I20260806 11:51:30.227495 22917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "f3bd82c80a9248589b34d681606a05dd"
format_stamp: "Formatted at 2026-08-06 11:51:30 on dist-test-slave-7z32"
server_key: "eab9347a68f66b00210f2bb28d7163a2"
server_key_iv: "c901dd9b9b121d0f8b015cbb77aab750"
server_key_version: "encryptionkey@0"
I20260806 11:51:30.232363 22917 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:51:30.236008 22938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:30.237937 22917 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:51:30.238155 22917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "f3bd82c80a9248589b34d681606a05dd"
format_stamp: "Formatted at 2026-08-06 11:51:30 on dist-test-slave-7z32"
server_key: "eab9347a68f66b00210f2bb28d7163a2"
server_key_iv: "c901dd9b9b121d0f8b015cbb77aab750"
server_key_version: "encryptionkey@0"
I20260806 11:51:30.238327 22917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:30.257633 22917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:30.261641 22917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:30.261909 22917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:30.270860 22917 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45785
I20260806 11:51:30.270958 23003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45785 every 8 connection(s)
I20260806 11:51:30.271991 22917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:30.276081 23005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:30.277230 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 22917
I20260806 11:51:30.277431 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:30.277863 27315 external_mini_cluster.cc:1428] Setting key c0931e5042dc412a0b250198a75b4988
I20260806 11:51:30.284679 23005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd: Bootstrap starting.
I20260806 11:51:30.288108 23005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:30.288831 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:30.279895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52695 (local address 127.0.0.1:45785)
0806 11:51:30.280587 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:30.280608 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:30.280653 (+ 45us) server_negotiation.cc:407] Connection header received
0806 11:51:30.281548 (+ 895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:30.281569 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:30.282000 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:30.282387 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:30.282931 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:30.283982 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:30.284934 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:30.285435 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:30.285611 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:30.286803 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:30.286811 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:30.286832 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:30.287345 (+ 513us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:30.287405 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:30.287431 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:30.287585 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:30.287772 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 11:51:30.287934 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":222,"threads_started":1}
I20260806 11:51:30.289211 23005 log.cc:824] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:30.292109 23005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd: No bootstrap required, opened a new log
I20260806 11:51:30.292477 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:30.297398 23005 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3bd82c80a9248589b34d681606a05dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45785 } }
I20260806 11:51:30.297797 23005 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:30.297860 23005 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3bd82c80a9248589b34d681606a05dd, State: Initialized, Role: FOLLOWER
I20260806 11:51:30.298599 23005 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3bd82c80a9248589b34d681606a05dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45785 } }
I20260806 11:51:30.298846 23005 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:30.298924 23005 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:30.299070 23005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:30.300109 23009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:30.294891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43023 (local address 127.0.0.1:45785)
0806 11:51:30.295065 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:30.295070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:30.295447 (+ 377us) server_negotiation.cc:407] Connection header received
0806 11:51:30.295631 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:30.295634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:30.295691 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:30.295772 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:30.296153 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:30.296741 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:30.297982 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:30.298271 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:30.298417 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:30.299557 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:30.299561 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:30.299563 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:30.299576 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:30.299603 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:30.299613 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:30.299683 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:30.299875 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 11:51:30.299911 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 11:51:30.300848 23005 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3bd82c80a9248589b34d681606a05dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45785 } }
I20260806 11:51:30.301494 23005 leader_election.cc:302] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3bd82c80a9248589b34d681606a05dd; no voters:
I20260806 11:51:30.301946 23005 leader_election.cc:288] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:30.302039 23020 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:30.302291 23020 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [term 1 LEADER]: Becoming Leader. State: Replica: f3bd82c80a9248589b34d681606a05dd, State: Running, Role: LEADER
I20260806 11:51:30.302657 23020 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3bd82c80a9248589b34d681606a05dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45785 } }
I20260806 11:51:30.303815 23005 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:30.304831 23022 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3bd82c80a9248589b34d681606a05dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3bd82c80a9248589b34d681606a05dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45785 } } }
I20260806 11:51:30.305011 23022 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:30.305439 23021 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3bd82c80a9248589b34d681606a05dd. Latest consensus state: current_term: 1 leader_uuid: "f3bd82c80a9248589b34d681606a05dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3bd82c80a9248589b34d681606a05dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45785 } } }
I20260806 11:51:30.305542 23021 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:30.305949 23031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:30.310292 23031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:30.317678 23031 catalog_manager.cc:1347] Generated new cluster ID: ac243e51f3164b7fbf5d5bb8d20e2bf8
I20260806 11:51:30.317777 23031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:30.347462 23031 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:30.349011 23031 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:30.364741 23031 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3bd82c80a9248589b34d681606a05dd: Generated new TSK 0
I20260806 11:51:30.365698 23031 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:30.380625 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 22917
W20260806 11:51:30.396400 22897 connection.cc:535] client connection to 127.0.0.1:45785 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45785): Connection reset by peer (error 104)
2026-08-06T11:51:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1816 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:30 dist-test-slave-7z32 krb5kdc[23045](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:30 dist-test-slave-7z32 krb5kdc[23045](info): set up 2 sockets
Aug 06 11:51:30 dist-test-slave-7z32 krb5kdc[23045](info): commencing operation
krb5kdc: starting...
W20260806 11:51:31.665473 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:31 dist-test-slave-7z32 krb5kdc[23045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:31.827392 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36669
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36669
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:31.970387 23060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:31.970764 23060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:31.970870 23060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:31.975396 23060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:31.975502 23060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:31.975523 23060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:31.975541 23060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:31.975558 23060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:31.981794 23060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36669
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:31.983397 23060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:31.984797 23060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:31.995666 23071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:31.995780 23067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:31.995764 23060 server_base.cc:1034] running on GCE node
W20260806 11:51:31.995743 23066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:31.996796 23060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:31.998225 23060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:31.999478 23060 hybrid_clock.cc:648] HybridClock initialized: now 1786017091999452 us; error 48 us; skew 500 ppm
Aug 06 11:51:31 dist-test-slave-7z32 krb5kdc[23045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017091, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:32.003549 23060 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:32.005147 23060 webserver.cc:460] Webserver started at http://127.0.0.1:35261/ using document root <none> and password file <none>
I20260806 11:51:32.006027 23060 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:32.006137 23060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:32.006486 23060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:32.009346 23060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "fa751478f9cc43b4b5a62dc444ab1664"
format_stamp: "Formatted at 2026-08-06 11:51:32 on dist-test-slave-7z32"
server_key: "970a1bf24b4c14a20755ae8169abcd03"
server_key_iv: "036969eb699dfae303c803232adb5079"
server_key_version: "encryptionkey@0"
I20260806 11:51:32.010038 23060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "fa751478f9cc43b4b5a62dc444ab1664"
format_stamp: "Formatted at 2026-08-06 11:51:32 on dist-test-slave-7z32"
server_key: "970a1bf24b4c14a20755ae8169abcd03"
server_key_iv: "036969eb699dfae303c803232adb5079"
server_key_version: "encryptionkey@0"
I20260806 11:51:32.014621 23060 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 11:51:32.017943 23080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:32.019850 23060 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:51:32.020069 23060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "fa751478f9cc43b4b5a62dc444ab1664"
format_stamp: "Formatted at 2026-08-06 11:51:32 on dist-test-slave-7z32"
server_key: "970a1bf24b4c14a20755ae8169abcd03"
server_key_iv: "036969eb699dfae303c803232adb5079"
server_key_version: "encryptionkey@0"
I20260806 11:51:32.020215 23060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:32.025504 23060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:32.029510 23060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:32.029752 23060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:32.038525 23060 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36669
I20260806 11:51:32.038552 23158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36669 every 8 connection(s)
I20260806 11:51:32.039772 23060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:32.043867 23159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:32.048763 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 23060
I20260806 11:51:32.048976 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:32.049408 27315 external_mini_cluster.cc:1428] Setting key bd2031d861663e882d7f84ab4381e729
I20260806 11:51:32.051890 23159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664: Bootstrap starting.
I20260806 11:51:32.056022 23159 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:32.057224 23159 log.cc:824] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:32.057399 23164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:32.051446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52777 (local address 127.0.0.1:36669)
0806 11:51:32.052080 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:32.052104 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:32.052160 (+ 56us) server_negotiation.cc:407] Connection header received
0806 11:51:32.053221 (+ 1061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:32.053266 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:32.053810 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:32.054383 (+ 573us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:32.055496 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:32.055502 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:32.055519 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:32.055531 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:32.055605 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:32.055635 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:32.055783 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:32.055933 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 11:51:32.056182 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":185,"threads_started":1}
I20260806 11:51:32.060437 23159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664: No bootstrap required, opened a new log
I20260806 11:51:32.061546 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:32.065730 23159 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa751478f9cc43b4b5a62dc444ab1664" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36669 } }
I20260806 11:51:32.066077 23159 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:32.066160 23159 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa751478f9cc43b4b5a62dc444ab1664, State: Initialized, Role: FOLLOWER
I20260806 11:51:32.066648 23164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:32.064374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36701 (local address 127.0.0.1:36669)
0806 11:51:32.064693 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:32.064701 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:32.064732 (+ 31us) server_negotiation.cc:407] Connection header received
0806 11:51:32.064911 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:32.064915 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:32.064965 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:32.065082 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:32.066080 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:32.066086 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:32.066092 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:32.066108 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:32.066140 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:32.066156 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:32.066276 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:32.066427 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 11:51:32.066479 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194}
I20260806 11:51:32.066911 23159 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa751478f9cc43b4b5a62dc444ab1664" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36669 } }
I20260806 11:51:32.067118 23159 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:32.067214 23159 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:32.067339 23159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:32.068779 23159 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa751478f9cc43b4b5a62dc444ab1664" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36669 } }
I20260806 11:51:32.069227 23159 leader_election.cc:302] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa751478f9cc43b4b5a62dc444ab1664; no voters:
I20260806 11:51:32.069669 23159 leader_election.cc:288] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:32.069887 23177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:32.070271 23177 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [term 1 LEADER]: Becoming Leader. State: Replica: fa751478f9cc43b4b5a62dc444ab1664, State: Running, Role: LEADER
I20260806 11:51:32.070783 23177 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa751478f9cc43b4b5a62dc444ab1664" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36669 } }
I20260806 11:51:32.071449 23159 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:32.073191 23178 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa751478f9cc43b4b5a62dc444ab1664" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa751478f9cc43b4b5a62dc444ab1664" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36669 } } }
I20260806 11:51:32.073207 23180 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa751478f9cc43b4b5a62dc444ab1664. Latest consensus state: current_term: 1 leader_uuid: "fa751478f9cc43b4b5a62dc444ab1664" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa751478f9cc43b4b5a62dc444ab1664" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36669 } } }
I20260806 11:51:32.073467 23178 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:32.073479 23180 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:32.074051 23196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:32.078488 23196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:32.085631 23196 catalog_manager.cc:1347] Generated new cluster ID: ce9ef2cadbec47d883c2ca75a8782b4f
I20260806 11:51:32.085763 23196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:32.102629 23196 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:32.103121 23196 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:32.120604 23196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa751478f9cc43b4b5a62dc444ab1664: Generated new TSK 0
I20260806 11:51:32.121520 23196 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:32.134462 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 23060
2026-08-06T11:51:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1753 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:32 dist-test-slave-7z32 krb5kdc[23205](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:32 dist-test-slave-7z32 krb5kdc[23205](info): set up 2 sockets
Aug 06 11:51:32 dist-test-slave-7z32 krb5kdc[23205](info): commencing operation
krb5kdc: starting...
W20260806 11:51:33.489321 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:33 dist-test-slave-7z32 krb5kdc[23205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:33.647251 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:33.811302 23224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:33.811936 23224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:33.812067 23224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:33.817889 23224 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:33.818076 23224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:33.818121 23224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:33.818171 23224 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:33.818222 23224 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:33.825773 23224 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:33.827557 23224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:33.828997 23224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:33.839922 23236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:33.839926 23240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:33.840358 23233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:33.840806 23224 server_base.cc:1034] running on GCE node
I20260806 11:51:33.841502 23224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:33.843029 23224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:33.844233 23224 hybrid_clock.cc:648] HybridClock initialized: now 1786017093844211 us; error 51 us; skew 500 ppm
Aug 06 11:51:33 dist-test-slave-7z32 krb5kdc[23205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017093, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:33.847967 23224 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:33.849509 23224 webserver.cc:460] Webserver started at http://127.0.0.1:46809/ using document root <none> and password file <none>
I20260806 11:51:33.850366 23224 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:33.850483 23224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:33.850872 23224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:33.853822 23224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "5aea436e1956476f96f7e7c1058486a8"
format_stamp: "Formatted at 2026-08-06 11:51:33 on dist-test-slave-7z32"
server_key: "07af76df9d4ce0944db76fc5440f99da"
server_key_iv: "7472de1ce339bd826ecc1fdfecb53fe4"
server_key_version: "encryptionkey@0"
I20260806 11:51:33.854599 23224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "5aea436e1956476f96f7e7c1058486a8"
format_stamp: "Formatted at 2026-08-06 11:51:33 on dist-test-slave-7z32"
server_key: "07af76df9d4ce0944db76fc5440f99da"
server_key_iv: "7472de1ce339bd826ecc1fdfecb53fe4"
server_key_version: "encryptionkey@0"
I20260806 11:51:33.860366 23224 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:51:33.863893 23251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:33.865674 23224 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 11:51:33.865952 23224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "5aea436e1956476f96f7e7c1058486a8"
format_stamp: "Formatted at 2026-08-06 11:51:33 on dist-test-slave-7z32"
server_key: "07af76df9d4ce0944db76fc5440f99da"
server_key_iv: "7472de1ce339bd826ecc1fdfecb53fe4"
server_key_version: "encryptionkey@0"
I20260806 11:51:33.866112 23224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:33.884078 23224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:33.888132 23224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:33.888397 23224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:33.898625 23224 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46469
I20260806 11:51:33.898766 23335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46469 every 8 connection(s)
I20260806 11:51:33.900146 23224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:33.903832 23336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:33.910373 23336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8: Bootstrap starting.
I20260806 11:51:33.910714 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 23224
I20260806 11:51:33.910984 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:33.911528 27315 external_mini_cluster.cc:1428] Setting key 2d855cf5b766cabe679d45ef6e25b3f0
I20260806 11:51:33.914075 23336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:33.915061 23336 log.cc:824] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:33.917701 23336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8: No bootstrap required, opened a new log
I20260806 11:51:33.922941 23336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aea436e1956476f96f7e7c1058486a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } }
I20260806 11:51:33.923311 23336 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:33.923369 23336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5aea436e1956476f96f7e7c1058486a8, State: Initialized, Role: FOLLOWER
I20260806 11:51:33.923909 23336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aea436e1956476f96f7e7c1058486a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } }
I20260806 11:51:33.924067 23336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:33.924175 23336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:33.924340 23336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [term 0 FOLLOWER]: Advancing to term 1
Aug 06 11:51:33 dist-test-slave-7z32 krb5kdc[23205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 11:51:33.925609 23336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aea436e1956476f96f7e7c1058486a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } }
I20260806 11:51:33.926024 23336 leader_election.cc:302] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5aea436e1956476f96f7e7c1058486a8; no voters:
I20260806 11:51:33.926422 23336 leader_election.cc:288] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:33.926981 23342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:33.927347 23342 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [term 1 LEADER]: Becoming Leader. State: Replica: 5aea436e1956476f96f7e7c1058486a8, State: Running, Role: LEADER
I20260806 11:51:33.927845 23342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aea436e1956476f96f7e7c1058486a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } }
I20260806 11:51:33.928021 23336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:33.930487 23343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5aea436e1956476f96f7e7c1058486a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aea436e1956476f96f7e7c1058486a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } } }
I20260806 11:51:33.930683 23343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:33.930931 23344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5aea436e1956476f96f7e7c1058486a8. Latest consensus state: current_term: 1 leader_uuid: "5aea436e1956476f96f7e7c1058486a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5aea436e1956476f96f7e7c1058486a8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46469 } } }
I20260806 11:51:33.931201 23344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:33.933197 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:33.913672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51131 (local address 127.0.0.1:46469)
0806 11:51:33.914275 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:33.914309 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:33.914357 (+ 48us) server_negotiation.cc:407] Connection header received
0806 11:51:33.915463 (+ 1106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:33.915490 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:33.915953 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:33.916599 (+ 646us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:33.917778 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:33.919238 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:33.920765 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:33.921424 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:33.921584 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:33.925233 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:33.925241 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:33.925263 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:33.925310 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:33.928081 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:33.928743 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:33.928750 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:33.928758 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:33.928940 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:33.929557 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:33.929579 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:33.929582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:33.930346 (+ 764us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:33.930618 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:33.931730 (+ 1112us) server_negotiation.cc:299] Negotiation successful
0806 11:51:33.932112 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":212,"threads_started":1}
W20260806 11:51:33.934700 23363 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:33.934841 23363 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:33.935132 23364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:33.936082 23364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:33.937681 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:33.942471 23364 catalog_manager.cc:1347] Generated new cluster ID: 8260adce51f54deeb04abb7b98f08229
I20260806 11:51:33.942553 23364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:33.952510 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:33.940933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49881 (local address 127.0.0.1:46469)
0806 11:51:33.941048 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:33.941053 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:33.941480 (+ 427us) server_negotiation.cc:407] Connection header received
0806 11:51:33.941647 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:33.941651 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:33.941709 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:33.941820 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:33.943100 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:33.944112 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:33.945591 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:33.946014 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:33.946110 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:33.948359 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:33.948366 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:33.948371 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:33.948409 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:33.950206 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:33.950808 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:33.950812 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:33.950814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:33.950950 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:33.951315 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:33.951319 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:33.951321 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:33.951599 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:33.951730 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:33.952143 (+ 413us) server_negotiation.cc:299] Negotiation successful
0806 11:51:33.952311 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 11:51:33.956820 23364 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:33.958565 23364 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:33.969756 23364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5aea436e1956476f96f7e7c1058486a8: Generated new TSK 0
I20260806 11:51:33.970970 23364 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:33.981042 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 23224
2026-08-06T11:51:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1845 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:34 dist-test-slave-7z32 krb5kdc[23380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:34 dist-test-slave-7z32 krb5kdc[23380](info): set up 2 sockets
Aug 06 11:51:34 dist-test-slave-7z32 krb5kdc[23380](info): commencing operation
krb5kdc: starting...
W20260806 11:51:35.328902 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.317s user 0.009s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:35 dist-test-slave-7z32 krb5kdc[23380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:35.491940 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41093
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:35.625352 23398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:35.625700 23398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:35.625746 23398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:35.630081 23398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:35.630182 23398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:35.630203 23398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:35.630219 23398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:35.630236 23398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:35.636183 23398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:35.637502 23398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:35.638698 23398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:35.649622 23408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:35.649622 23405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:35.649650 23406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:35.649852 23398 server_base.cc:1034] running on GCE node
I20260806 11:51:35.651059 23398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:35.652729 23398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:35.653960 23398 hybrid_clock.cc:648] HybridClock initialized: now 1786017095653935 us; error 51 us; skew 500 ppm
Aug 06 11:51:35 dist-test-slave-7z32 krb5kdc[23380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017095, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:35.665402 23398 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:35.666970 23398 webserver.cc:460] Webserver started at http://127.0.0.1:37581/ using document root <none> and password file <none>
I20260806 11:51:35.667776 23398 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:35.667887 23398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:35.668190 23398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:35.671008 23398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "dbd15e45328541c9876e9e48bb09af12"
format_stamp: "Formatted at 2026-08-06 11:51:35 on dist-test-slave-7z32"
server_key: "513e1a9bf7ab8a78c66fa3bb1529df40"
server_key_iv: "bb40137cb9b15cc150cf6b676b30b2b7"
server_key_version: "encryptionkey@0"
I20260806 11:51:35.671770 23398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "dbd15e45328541c9876e9e48bb09af12"
format_stamp: "Formatted at 2026-08-06 11:51:35 on dist-test-slave-7z32"
server_key: "513e1a9bf7ab8a78c66fa3bb1529df40"
server_key_iv: "bb40137cb9b15cc150cf6b676b30b2b7"
server_key_version: "encryptionkey@0"
I20260806 11:51:35.677120 23398 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:51:35.681373 23419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:35.683466 23398 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:51:35.683705 23398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "dbd15e45328541c9876e9e48bb09af12"
format_stamp: "Formatted at 2026-08-06 11:51:35 on dist-test-slave-7z32"
server_key: "513e1a9bf7ab8a78c66fa3bb1529df40"
server_key_iv: "bb40137cb9b15cc150cf6b676b30b2b7"
server_key_version: "encryptionkey@0"
I20260806 11:51:35.683892 23398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:35.713464 23398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:35.717821 23398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:35.718122 23398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:35.728276 23398 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41093
I20260806 11:51:35.728298 23509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41093 every 8 connection(s)
I20260806 11:51:35.729664 23398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:35.733105 23512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:35.733528 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 23398
I20260806 11:51:35.733700 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:35.734113 27315 external_mini_cluster.cc:1428] Setting key 7b1430b1dd81a052ec4589913f03f56a
I20260806 11:51:35.740268 23512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12: Bootstrap starting.
I20260806 11:51:35.742763 23512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:35.743633 23512 log.cc:824] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:35.745831 23520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:35.736151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46853 (local address 127.0.0.1:41093)
0806 11:51:35.736777 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:35.736799 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:35.736849 (+ 50us) server_negotiation.cc:407] Connection header received
0806 11:51:35.737714 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:35.737736 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:35.738274 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:35.738689 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:35.739256 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:35.740469 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:35.741474 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:35.742057 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:35.742266 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:35.743348 (+ 1082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:35.743354 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:35.743372 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:35.743980 (+ 608us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:35.744056 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:35.744118 (+ 62us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:35.744252 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:35.744527 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 11:51:35.744807 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":195,"threads_started":1}
I20260806 11:51:35.746254 23512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12: No bootstrap required, opened a new log
I20260806 11:51:35.749645 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:35.750469 23512 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd15e45328541c9876e9e48bb09af12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41093 } }
I20260806 11:51:35.750775 23512 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:35.750895 23512 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd15e45328541c9876e9e48bb09af12, State: Initialized, Role: FOLLOWER
I20260806 11:51:35.751359 23512 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd15e45328541c9876e9e48bb09af12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41093 } }
I20260806 11:51:35.751523 23512 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:35.751618 23512 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:35.751747 23512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:35.752768 23512 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd15e45328541c9876e9e48bb09af12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41093 } }
I20260806 11:51:35.753180 23512 leader_election.cc:302] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbd15e45328541c9876e9e48bb09af12; no voters:
I20260806 11:51:35.753593 23512 leader_election.cc:288] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:35.753813 23529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:35.754132 23529 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [term 1 LEADER]: Becoming Leader. State: Replica: dbd15e45328541c9876e9e48bb09af12, State: Running, Role: LEADER
I20260806 11:51:35.754662 23529 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd15e45328541c9876e9e48bb09af12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41093 } }
I20260806 11:51:35.755053 23512 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:35.756469 23529 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbd15e45328541c9876e9e48bb09af12. Latest consensus state: current_term: 1 leader_uuid: "dbd15e45328541c9876e9e48bb09af12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd15e45328541c9876e9e48bb09af12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41093 } } }
I20260806 11:51:35.756649 23529 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:35.756943 23530 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbd15e45328541c9876e9e48bb09af12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbd15e45328541c9876e9e48bb09af12" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41093 } } }
I20260806 11:51:35.757079 23530 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:35.759395 23520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:35.752974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58973 (local address 127.0.0.1:41093)
0806 11:51:35.753145 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:35.753150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:35.753370 (+ 220us) server_negotiation.cc:407] Connection header received
0806 11:51:35.753496 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:35.753503 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:35.753570 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:35.753685 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:35.754208 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:35.755152 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:35.756498 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:35.756909 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:35.757004 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:35.758720 (+ 1716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:35.758724 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:35.758727 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:35.758745 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:35.758779 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:35.758795 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:35.758886 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:35.759120 (+ 234us) server_negotiation.cc:299] Negotiation successful
0806 11:51:35.759229 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 11:51:35.761755 23551 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:35.761875 23551 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:35.761967 23543 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:35.763022 23543 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:35.771329 23543 catalog_manager.cc:1347] Generated new cluster ID: 4e039e96857a49a5aa835504160a8165
I20260806 11:51:35.771441 23543 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:35.793404 23543 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:35.795069 23543 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:35.805452 23543 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbd15e45328541c9876e9e48bb09af12: Generated new TSK 0
I20260806 11:51:35.806499 23543 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:35.811125 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 23398
2026-08-06T11:51:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1826 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:35 dist-test-slave-7z32 krb5kdc[23563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:35 dist-test-slave-7z32 krb5kdc[23563](info): set up 2 sockets
Aug 06 11:51:35 dist-test-slave-7z32 krb5kdc[23563](info): commencing operation
krb5kdc: starting...
W20260806 11:51:37.084757 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:37 dist-test-slave-7z32 krb5kdc[23563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:37.248165 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36689
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:37.389326 23578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:37.389808 23578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:37.389909 23578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:37.394717 23578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:37.394867 23578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:37.394922 23578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:37.394959 23578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:37.395020 23578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:37.401235 23578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36689
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:37.402909 23578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:37.404326 23578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:37.415766 23588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:37.415944 23587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:37.415791 23590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:37.416388 23578 server_base.cc:1034] running on GCE node
I20260806 11:51:37.417253 23578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:37.418891 23578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:37.420176 23578 hybrid_clock.cc:648] HybridClock initialized: now 1786017097420146 us; error 47 us; skew 500 ppm
Aug 06 11:51:37 dist-test-slave-7z32 krb5kdc[23563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017097, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:37.424021 23578 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:37.425231 23578 webserver.cc:460] Webserver started at http://127.0.0.1:41255/ using document root <none> and password file <none>
I20260806 11:51:37.426011 23578 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:37.426115 23578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:37.426496 23578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:37.429263 23578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "e1a45c8d22504ab2a68ddc8101481aea"
format_stamp: "Formatted at 2026-08-06 11:51:37 on dist-test-slave-7z32"
server_key: "579e7d064d596a11d54a46c44ba0b20e"
server_key_iv: "c4a2fc4eb7ad868f0616bab2beb57a20"
server_key_version: "encryptionkey@0"
I20260806 11:51:37.429947 23578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "e1a45c8d22504ab2a68ddc8101481aea"
format_stamp: "Formatted at 2026-08-06 11:51:37 on dist-test-slave-7z32"
server_key: "579e7d064d596a11d54a46c44ba0b20e"
server_key_iv: "c4a2fc4eb7ad868f0616bab2beb57a20"
server_key_version: "encryptionkey@0"
I20260806 11:51:37.435037 23578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 11:51:37.438505 23604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:37.440467 23578 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:51:37.440681 23578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "e1a45c8d22504ab2a68ddc8101481aea"
format_stamp: "Formatted at 2026-08-06 11:51:37 on dist-test-slave-7z32"
server_key: "579e7d064d596a11d54a46c44ba0b20e"
server_key_iv: "c4a2fc4eb7ad868f0616bab2beb57a20"
server_key_version: "encryptionkey@0"
I20260806 11:51:37.440841 23578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:37.446777 23578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:37.450796 23578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:37.451149 23578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:37.461213 23578 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36689
I20260806 11:51:37.461268 23682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36689 every 8 connection(s)
I20260806 11:51:37.462620 23578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:37.466221 23683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:37.468921 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 23578
I20260806 11:51:37.469178 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:37.469553 27315 external_mini_cluster.cc:1428] Setting key 7db4572c6773403bff606cee618a9824
I20260806 11:51:37.473706 23683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea: Bootstrap starting.
I20260806 11:51:37.476699 23687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:37.471383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34159 (local address 127.0.0.1:36689)
0806 11:51:37.472072 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:37.472101 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:37.472169 (+ 68us) server_negotiation.cc:407] Connection header received
0806 11:51:37.473069 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:37.473096 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:37.473537 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:37.474077 (+ 540us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:37.475107 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:37.475112 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:37.475126 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:37.475137 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:37.475203 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:37.475227 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:37.475458 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:37.475542 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 11:51:37.475752 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":195,"threads_started":1}
I20260806 11:51:37.476722 23683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:37.477835 23683 log.cc:824] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:37.480811 23683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea: No bootstrap required, opened a new log
I20260806 11:51:37.480798 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:37.485710 23683 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a45c8d22504ab2a68ddc8101481aea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36689 } }
I20260806 11:51:37.486093 23683 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:37.486132 23687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:37.483628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44479 (local address 127.0.0.1:36689)
0806 11:51:37.483790 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:37.483794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:37.484034 (+ 240us) server_negotiation.cc:407] Connection header received
0806 11:51:37.484256 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:37.484259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:37.484300 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:37.484384 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:37.485507 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:37.485510 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:37.485512 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:37.485524 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:37.485555 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:37.485580 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:37.485667 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:37.485841 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 11:51:37.485891 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 11:51:37.486161 23683 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a45c8d22504ab2a68ddc8101481aea, State: Initialized, Role: FOLLOWER
I20260806 11:51:37.486809 23683 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a45c8d22504ab2a68ddc8101481aea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36689 } }
I20260806 11:51:37.487016 23683 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:37.487095 23683 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:37.487216 23683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:37.488332 23683 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a45c8d22504ab2a68ddc8101481aea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36689 } }
I20260806 11:51:37.488740 23683 leader_election.cc:302] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1a45c8d22504ab2a68ddc8101481aea; no voters:
I20260806 11:51:37.489120 23683 leader_election.cc:288] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:37.489410 23697 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:37.489835 23697 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [term 1 LEADER]: Becoming Leader. State: Replica: e1a45c8d22504ab2a68ddc8101481aea, State: Running, Role: LEADER
I20260806 11:51:37.490295 23697 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a45c8d22504ab2a68ddc8101481aea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36689 } }
I20260806 11:51:37.490610 23683 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:37.492910 23698 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1a45c8d22504ab2a68ddc8101481aea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a45c8d22504ab2a68ddc8101481aea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36689 } } }
I20260806 11:51:37.493100 23698 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:37.492929 23700 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1a45c8d22504ab2a68ddc8101481aea. Latest consensus state: current_term: 1 leader_uuid: "e1a45c8d22504ab2a68ddc8101481aea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a45c8d22504ab2a68ddc8101481aea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36689 } } }
I20260806 11:51:37.494059 23700 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea [sys.catalog]: This master's current role is: LEADER
W20260806 11:51:37.497006 23718 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:37.497131 23718 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:37.497363 23719 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:37.498610 23719 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:37.506273 23719 catalog_manager.cc:1347] Generated new cluster ID: c652a5c3f35b4335b92f70ab67625b61
I20260806 11:51:37.506386 23719 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:37.520707 23719 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:37.521225 23719 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:37.532011 23719 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1a45c8d22504ab2a68ddc8101481aea: Generated new TSK 0
I20260806 11:51:37.533061 23719 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:37.546896 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 23578
2026-08-06T11:51:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1740 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:37 dist-test-slave-7z32 krb5kdc[23726](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:37 dist-test-slave-7z32 krb5kdc[23726](info): set up 2 sockets
Aug 06 11:51:37 dist-test-slave-7z32 krb5kdc[23726](info): commencing operation
krb5kdc: starting...
W20260806 11:51:38.818531 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:38 dist-test-slave-7z32 krb5kdc[23726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:38.992796 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40375
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40375
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:39.125224 23743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:39.125554 23743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:39.125602 23743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:39.129803 23743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:39.129882 23743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:39.129902 23743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:39.129921 23743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:39.129938 23743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:39.135665 23743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40375
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:39.136957 23743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:39.138118 23743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:39.148423 23752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:39.148344 23749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:39.148324 23755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:39.148998 23743 server_base.cc:1034] running on GCE node
I20260806 11:51:39.149863 23743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:39.151501 23743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:39.152763 23743 hybrid_clock.cc:648] HybridClock initialized: now 1786017099152716 us; error 41 us; skew 500 ppm
Aug 06 11:51:39 dist-test-slave-7z32 krb5kdc[23726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017099, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:39.156915 23743 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:39.158176 23743 webserver.cc:460] Webserver started at http://127.0.0.1:34493/ using document root <none> and password file <none>
I20260806 11:51:39.159029 23743 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:39.159139 23743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:39.159435 23743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:39.162156 23743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "fbc8d962a9994eb19377aebd63276e16"
format_stamp: "Formatted at 2026-08-06 11:51:39 on dist-test-slave-7z32"
server_key: "b5d67ff982108b3090e7b5e66da251fe"
server_key_iv: "b934b3af6b70dee6288cbcd0367a3fcc"
server_key_version: "encryptionkey@0"
I20260806 11:51:39.162967 23743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "fbc8d962a9994eb19377aebd63276e16"
format_stamp: "Formatted at 2026-08-06 11:51:39 on dist-test-slave-7z32"
server_key: "b5d67ff982108b3090e7b5e66da251fe"
server_key_iv: "b934b3af6b70dee6288cbcd0367a3fcc"
server_key_version: "encryptionkey@0"
I20260806 11:51:39.168817 23743 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:51:39.172597 23764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:39.174531 23743 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:39.174746 23743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "fbc8d962a9994eb19377aebd63276e16"
format_stamp: "Formatted at 2026-08-06 11:51:39 on dist-test-slave-7z32"
server_key: "b5d67ff982108b3090e7b5e66da251fe"
server_key_iv: "b934b3af6b70dee6288cbcd0367a3fcc"
server_key_version: "encryptionkey@0"
I20260806 11:51:39.174976 23743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:39.188005 23743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:39.192008 23743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:39.192265 23743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:39.201371 23743 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40375
I20260806 11:51:39.201478 23836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40375 every 8 connection(s)
I20260806 11:51:39.202639 23743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:39.203326 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 23743
I20260806 11:51:39.203553 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:39.203956 27315 external_mini_cluster.cc:1428] Setting key 9ffc55d3a83aa11abacd9fcc47887bd4
I20260806 11:51:39.206336 23837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:39.213253 23837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16: Bootstrap starting.
Aug 06 11:51:39 dist-test-slave-7z32 krb5kdc[23726](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 11:51:39.215984 23837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:39.217051 23837 log.cc:824] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:39.219952 23837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16: No bootstrap required, opened a new log
I20260806 11:51:39.223105 23841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:39.205928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:36519 (local address 127.0.0.1:40375)
0806 11:51:39.206513 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:39.206538 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:39.206600 (+ 62us) server_negotiation.cc:407] Connection header received
0806 11:51:39.207479 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:39.207502 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:39.207983 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:39.208371 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:39.209472 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:39.210739 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:39.211888 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:39.212454 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:39.212665 (+ 211us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:39.215949 (+ 3284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:39.215959 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:39.215980 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:39.216029 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:39.218927 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:39.219665 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:39.219673 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:39.219680 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:39.219826 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:39.220294 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:39.220304 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:39.220305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:39.220874 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:39.221169 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:39.221581 (+ 412us) server_negotiation.cc:299] Negotiation successful
0806 11:51:39.221903 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":198,"threads_started":1}
I20260806 11:51:39.224354 23837 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc8d962a9994eb19377aebd63276e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40375 } }
I20260806 11:51:39.224713 23837 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:39.224789 23837 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc8d962a9994eb19377aebd63276e16, State: Initialized, Role: FOLLOWER
I20260806 11:51:39.225337 23837 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc8d962a9994eb19377aebd63276e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40375 } }
I20260806 11:51:39.225500 23837 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:39.225558 23837 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:39.225659 23837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:39.227092 23837 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc8d962a9994eb19377aebd63276e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40375 } }
I20260806 11:51:39.227522 23837 leader_election.cc:302] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbc8d962a9994eb19377aebd63276e16; no voters:
I20260806 11:51:39.227948 23837 leader_election.cc:288] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:39.227967 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:39.228037 23844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:39.228273 23844 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [term 1 LEADER]: Becoming Leader. State: Replica: fbc8d962a9994eb19377aebd63276e16, State: Running, Role: LEADER
I20260806 11:51:39.228628 23844 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc8d962a9994eb19377aebd63276e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40375 } }
I20260806 11:51:39.229456 23837 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:39.230036 23844 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbc8d962a9994eb19377aebd63276e16. Latest consensus state: current_term: 1 leader_uuid: "fbc8d962a9994eb19377aebd63276e16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc8d962a9994eb19377aebd63276e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40375 } } }
I20260806 11:51:39.230162 23844 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:39.230584 23845 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbc8d962a9994eb19377aebd63276e16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc8d962a9994eb19377aebd63276e16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40375 } } }
I20260806 11:51:39.230755 23845 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:39.230767 23859 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:39.236567 23859 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:39.243300 23841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:39.231914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:57411 (local address 127.0.0.1:40375)
0806 11:51:39.232104 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:39.232111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:39.233146 (+ 1035us) server_negotiation.cc:407] Connection header received
0806 11:51:39.233348 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:39.233352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:39.233415 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:39.233475 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:39.234617 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:39.235452 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:39.236610 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:39.237018 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:39.237206 (+ 188us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:39.239556 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:39.239560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:39.239562 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:39.239593 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:39.241220 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:39.241758 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:39.241769 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:39.241771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:39.241856 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:39.242212 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:39.242216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:39.242218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:39.242428 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:39.242596 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:39.242934 (+ 338us) server_negotiation.cc:299] Negotiation successful
0806 11:51:39.243089 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 11:51:39.245265 23859 catalog_manager.cc:1347] Generated new cluster ID: c0f58e180f674c58994f8cb39a266a13
I20260806 11:51:39.245354 23859 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:39.261310 23859 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:39.263362 23859 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:39.278337 23859 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbc8d962a9994eb19377aebd63276e16: Generated new TSK 0
I20260806 11:51:39.279484 23859 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:39.286731 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 23743
W20260806 11:51:39.306847 23724 connection.cc:535] client connection to 127.0.0.1:40375 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40375): Connection reset by peer (error 104)
2026-08-06T11:51:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1744 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:39 dist-test-slave-7z32 krb5kdc[23889](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:39 dist-test-slave-7z32 krb5kdc[23889](info): set up 2 sockets
Aug 06 11:51:39 dist-test-slave-7z32 krb5kdc[23889](info): commencing operation
krb5kdc: starting...
W20260806 11:51:40.565876 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:40 dist-test-slave-7z32 krb5kdc[23889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:40.735606 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45949
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:40.865181 23914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:40.865563 23914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:40.865648 23914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:40.869804 23914 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:40.869933 23914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:40.869972 23914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:40.870005 23914 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:40.870064 23914 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:40.875758 23914 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:40.877063 23914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:40.878204 23914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:40.888976 23925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:40.889025 23922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:40.889025 23927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:40.889739 23914 server_base.cc:1034] running on GCE node
I20260806 11:51:40.890484 23914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:40.891923 23914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:40.893169 23914 hybrid_clock.cc:648] HybridClock initialized: now 1786017100893145 us; error 49 us; skew 500 ppm
Aug 06 11:51:40 dist-test-slave-7z32 krb5kdc[23889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017100, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:40.901033 23914 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:40.902309 23914 webserver.cc:460] Webserver started at http://127.0.0.1:41635/ using document root <none> and password file <none>
I20260806 11:51:40.903095 23914 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:40.903201 23914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:40.903477 23914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:40.905910 23914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "122cf9505f1d40258e65f2cf105f2535"
format_stamp: "Formatted at 2026-08-06 11:51:40 on dist-test-slave-7z32"
server_key: "6b2134d3b01bffefe8a3369126ac1a15"
server_key_iv: "1899c65360a0934e3d3c3c17cce8712f"
server_key_version: "encryptionkey@0"
I20260806 11:51:40.906550 23914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "122cf9505f1d40258e65f2cf105f2535"
format_stamp: "Formatted at 2026-08-06 11:51:40 on dist-test-slave-7z32"
server_key: "6b2134d3b01bffefe8a3369126ac1a15"
server_key_iv: "1899c65360a0934e3d3c3c17cce8712f"
server_key_version: "encryptionkey@0"
I20260806 11:51:40.911588 23914 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260806 11:51:40.915223 23938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:40.917385 23914 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:40.917666 23914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "122cf9505f1d40258e65f2cf105f2535"
format_stamp: "Formatted at 2026-08-06 11:51:40 on dist-test-slave-7z32"
server_key: "6b2134d3b01bffefe8a3369126ac1a15"
server_key_iv: "1899c65360a0934e3d3c3c17cce8712f"
server_key_version: "encryptionkey@0"
I20260806 11:51:40.917847 23914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:40.948263 23914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:40.951970 23914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:40.952204 23914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:40.960803 23914 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45949
I20260806 11:51:40.960875 24010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45949 every 8 connection(s)
I20260806 11:51:40.961970 23914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:40.965926 24012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:40.967793 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 23914
I20260806 11:51:40.967939 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:40.968333 27315 external_mini_cluster.cc:1428] Setting key 410b1ef99a31d5c5c2891cbb0c86303f
I20260806 11:51:40.974443 24012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535: Bootstrap starting.
I20260806 11:51:40.978152 24012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:40.979413 24012 log.cc:824] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:40.980433 24015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:40.970000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:53923 (local address 127.0.0.1:45949)
0806 11:51:40.970530 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:40.970549 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:40.970592 (+ 43us) server_negotiation.cc:407] Connection header received
0806 11:51:40.971521 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:40.971543 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:40.972185 (+ 642us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:40.972614 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:40.973204 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:40.974312 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:40.975733 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:40.976307 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:40.976538 (+ 231us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:40.977842 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:40.977848 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:40.977866 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:40.978488 (+ 622us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:40.978564 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:40.978593 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:40.978755 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:40.979031 (+ 276us) server_negotiation.cc:299] Negotiation successful
0806 11:51:40.979181 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":168,"threads_started":1}
I20260806 11:51:40.982525 24012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535: No bootstrap required, opened a new log
I20260806 11:51:40.984807 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:40.987368 24012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122cf9505f1d40258e65f2cf105f2535" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } }
I20260806 11:51:40.987816 24012 raft_consensus.cc:374] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:40.987905 24012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 122cf9505f1d40258e65f2cf105f2535, State: Initialized, Role: FOLLOWER
I20260806 11:51:40.988461 24012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122cf9505f1d40258e65f2cf105f2535" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } }
I20260806 11:51:40.988672 24012 raft_consensus.cc:388] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:40.988765 24012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:40.988910 24012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:40.990252 24012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122cf9505f1d40258e65f2cf105f2535" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } }
I20260806 11:51:40.990701 24012 leader_election.cc:302] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 122cf9505f1d40258e65f2cf105f2535; no voters:
I20260806 11:51:40.991182 24012 leader_election.cc:288] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:40.991349 24023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:40.991714 24023 raft_consensus.cc:686] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [term 1 LEADER]: Becoming Leader. State: Replica: 122cf9505f1d40258e65f2cf105f2535, State: Running, Role: LEADER
I20260806 11:51:40.992254 24023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122cf9505f1d40258e65f2cf105f2535" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } }
I20260806 11:51:40.992455 24015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:40.987494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:37463 (local address 127.0.0.1:45949)
0806 11:51:40.987659 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:40.987665 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:40.987763 (+ 98us) server_negotiation.cc:407] Connection header received
0806 11:51:40.987979 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:40.987984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:40.988055 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:40.988138 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:40.988530 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:40.989269 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:40.990137 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:40.990456 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:40.990564 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:40.991796 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:40.991803 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:40.991809 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:40.991834 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:40.991866 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:40.991880 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:40.991971 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:40.992236 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 11:51:40.992299 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 11:51:40.993155 24012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:40.994534 24025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 122cf9505f1d40258e65f2cf105f2535. Latest consensus state: current_term: 1 leader_uuid: "122cf9505f1d40258e65f2cf105f2535" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122cf9505f1d40258e65f2cf105f2535" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } } }
I20260806 11:51:40.994764 24025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:40.995195 24024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "122cf9505f1d40258e65f2cf105f2535" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "122cf9505f1d40258e65f2cf105f2535" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } } }
I20260806 11:51:40.995283 24024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:40.996479 24035 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:41.000746 24035 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:41.009027 24035 catalog_manager.cc:1347] Generated new cluster ID: b21cb30d308a44f6bfa1b8c53d122d4b
I20260806 11:51:41.009145 24035 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:41.044077 24035 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:41.045413 24035 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:41.058539 24035 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 122cf9505f1d40258e65f2cf105f2535: Generated new TSK 0
I20260806 11:51:41.059494 24035 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:41.073438 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 23914
W20260806 11:51:41.088101 23887 connection.cc:535] client connection to 127.0.0.1:45949 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45949): Connection reset by peer (error 104)
2026-08-06T11:51:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1780 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:41 dist-test-slave-7z32 krb5kdc[24053](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:41 dist-test-slave-7z32 krb5kdc[24053](info): set up 2 sockets
Aug 06 11:51:41 dist-test-slave-7z32 krb5kdc[24053](info): commencing operation
krb5kdc: starting...
W20260806 11:51:42.379158 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.001s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:42 dist-test-slave-7z32 krb5kdc[24053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:42.543462 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40119
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:42.687464 24071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:42.687893 24071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:42.687984 24071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:42.692744 24071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:42.692889 24071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:42.692924 24071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:42.692953 24071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:42.692993 24071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:42.699469 24071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:42.701122 24071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:42.702549 24071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:42.714231 24080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:42.714157 24082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:42.714206 24079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:42.714424 24071 server_base.cc:1034] running on GCE node
I20260806 11:51:42.715485 24071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:42.717353 24071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:42.718644 24071 hybrid_clock.cc:648] HybridClock initialized: now 1786017102718619 us; error 46 us; skew 500 ppm
Aug 06 11:51:42 dist-test-slave-7z32 krb5kdc[24053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017102, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:42.723127 24071 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:42.724546 24071 webserver.cc:460] Webserver started at http://127.0.0.1:36003/ using document root <none> and password file <none>
I20260806 11:51:42.725374 24071 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:42.725631 24071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:42.726070 24071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:42.728883 24071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "5087d776dcb848449a260e3007c3a015"
format_stamp: "Formatted at 2026-08-06 11:51:42 on dist-test-slave-7z32"
server_key: "ccc96c7af5a00b3890ef0e680a80ad9a"
server_key_iv: "07766429bcaac3f5d04b4bf8b399c709"
server_key_version: "encryptionkey@0"
I20260806 11:51:42.729588 24071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "5087d776dcb848449a260e3007c3a015"
format_stamp: "Formatted at 2026-08-06 11:51:42 on dist-test-slave-7z32"
server_key: "ccc96c7af5a00b3890ef0e680a80ad9a"
server_key_iv: "07766429bcaac3f5d04b4bf8b399c709"
server_key_version: "encryptionkey@0"
I20260806 11:51:42.734704 24071 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260806 11:51:42.738296 24093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:42.740396 24071 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:51:42.740636 24071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "5087d776dcb848449a260e3007c3a015"
format_stamp: "Formatted at 2026-08-06 11:51:42 on dist-test-slave-7z32"
server_key: "ccc96c7af5a00b3890ef0e680a80ad9a"
server_key_iv: "07766429bcaac3f5d04b4bf8b399c709"
server_key_version: "encryptionkey@0"
I20260806 11:51:42.740803 24071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:42.746795 24071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:42.751117 24071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:42.751433 24071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:42.760906 24071 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40119
I20260806 11:51:42.760975 24176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40119 every 8 connection(s)
I20260806 11:51:42.762104 24071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:42.765208 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 24071
I20260806 11:51:42.765404 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:42.765815 27315 external_mini_cluster.cc:1428] Setting key e6e34650df8a2112bac5244220aa87b0
I20260806 11:51:42.766954 24178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:42.773155 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:42.767958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:57669 (local address 127.0.0.1:40119)
0806 11:51:42.768658 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:42.768679 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:42.768731 (+ 52us) server_negotiation.cc:407] Connection header received
0806 11:51:42.769543 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:42.769563 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:42.769964 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:42.770427 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:42.771606 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:42.771612 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:42.771626 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:42.771640 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:42.771707 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:42.771730 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:42.771940 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:42.772029 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 11:51:42.772234 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":217,"threads_started":1}
I20260806 11:51:42.775753 24178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015: Bootstrap starting.
I20260806 11:51:42.777330 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:42.780086 24178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:42.781306 24178 log.cc:824] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:42.782685 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:42.780390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:40679 (local address 127.0.0.1:40119)
0806 11:51:42.780588 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:42.780594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:42.780743 (+ 149us) server_negotiation.cc:407] Connection header received
0806 11:51:42.780907 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:42.780911 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:42.780970 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:42.781111 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:42.782126 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:42.782130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:42.782132 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:42.782145 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:42.782182 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:42.782193 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:42.782292 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:42.782444 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 11:51:42.782490 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 11:51:42.784679 24178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015: No bootstrap required, opened a new log
I20260806 11:51:42.789561 24178 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5087d776dcb848449a260e3007c3a015" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } }
I20260806 11:51:42.789901 24178 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:42.789987 24178 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5087d776dcb848449a260e3007c3a015, State: Initialized, Role: FOLLOWER
I20260806 11:51:42.790562 24178 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5087d776dcb848449a260e3007c3a015" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } }
I20260806 11:51:42.790707 24178 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:42.790814 24178 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:42.791002 24178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:42.792359 24178 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5087d776dcb848449a260e3007c3a015" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } }
I20260806 11:51:42.792838 24178 leader_election.cc:302] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5087d776dcb848449a260e3007c3a015; no voters:
I20260806 11:51:42.793282 24178 leader_election.cc:288] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:42.793516 24193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:42.793956 24193 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [term 1 LEADER]: Becoming Leader. State: Replica: 5087d776dcb848449a260e3007c3a015, State: Running, Role: LEADER
I20260806 11:51:42.794384 24193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5087d776dcb848449a260e3007c3a015" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } }
I20260806 11:51:42.795120 24178 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:42.797178 24197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5087d776dcb848449a260e3007c3a015. Latest consensus state: current_term: 1 leader_uuid: "5087d776dcb848449a260e3007c3a015" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5087d776dcb848449a260e3007c3a015" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } } }
I20260806 11:51:42.797248 24194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5087d776dcb848449a260e3007c3a015" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5087d776dcb848449a260e3007c3a015" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } } }
I20260806 11:51:42.797358 24197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:42.797380 24194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:42.797854 24207 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:42.802534 24207 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:42.809980 24207 catalog_manager.cc:1347] Generated new cluster ID: edb3bcc3a6be425f8b871b6f56f52bc8
I20260806 11:51:42.810101 24207 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:42.833979 24207 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:42.834534 24207 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:42.848307 24207 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5087d776dcb848449a260e3007c3a015: Generated new TSK 0
I20260806 11:51:42.849377 24207 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:42.859175 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 24071
2026-08-06T11:51:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1787 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:42 dist-test-slave-7z32 krb5kdc[24223](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:42 dist-test-slave-7z32 krb5kdc[24223](info): set up 2 sockets
Aug 06 11:51:42 dist-test-slave-7z32 krb5kdc[24223](info): commencing operation
krb5kdc: starting...
W20260806 11:51:44.198205 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.008s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:44 dist-test-slave-7z32 krb5kdc[24223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:44.363341 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38299
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:44.511078 24237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:44.511469 24237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:44.511523 24237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:44.516189 24237 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:44.516301 24237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:44.516323 24237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:44.516342 24237 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:44.516386 24237 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:44.523154 24237 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38299
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:44.524876 24237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:44.526338 24237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:44.537999 24247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:44.538034 24244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:44.537999 24245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:44.538901 24237 server_base.cc:1034] running on GCE node
I20260806 11:51:44.539765 24237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:44.541167 24237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:44.542404 24237 hybrid_clock.cc:648] HybridClock initialized: now 1786017104542382 us; error 41 us; skew 500 ppm
Aug 06 11:51:44 dist-test-slave-7z32 krb5kdc[24223](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017104, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:44.545981 24237 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:44.547153 24237 webserver.cc:460] Webserver started at http://127.0.0.1:40607/ using document root <none> and password file <none>
I20260806 11:51:44.547855 24237 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:44.547959 24237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:44.548226 24237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:44.550519 24237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "799cee62d32a4a04af808b39b951eb59"
format_stamp: "Formatted at 2026-08-06 11:51:44 on dist-test-slave-7z32"
server_key: "c09398d885ffb26fe81ef85042cffbe2"
server_key_iv: "2e673a2f0a921f60f9fc6275fd9add72"
server_key_version: "encryptionkey@0"
I20260806 11:51:44.551172 24237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "799cee62d32a4a04af808b39b951eb59"
format_stamp: "Formatted at 2026-08-06 11:51:44 on dist-test-slave-7z32"
server_key: "c09398d885ffb26fe81ef85042cffbe2"
server_key_iv: "2e673a2f0a921f60f9fc6275fd9add72"
server_key_version: "encryptionkey@0"
I20260806 11:51:44.555852 24237 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 11:51:44.559087 24254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:44.560750 24237 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 11:51:44.560971 24237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "799cee62d32a4a04af808b39b951eb59"
format_stamp: "Formatted at 2026-08-06 11:51:44 on dist-test-slave-7z32"
server_key: "c09398d885ffb26fe81ef85042cffbe2"
server_key_iv: "2e673a2f0a921f60f9fc6275fd9add72"
server_key_version: "encryptionkey@0"
I20260806 11:51:44.561111 24237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:44.585150 24237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:44.588967 24237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:44.589217 24237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:44.597967 24237 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38299
I20260806 11:51:44.598033 24331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38299 every 8 connection(s)
I20260806 11:51:44.599186 24237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:44.604660 24332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:44.604648 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 24237
I20260806 11:51:44.604833 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:44.605257 27315 external_mini_cluster.cc:1428] Setting key eab9b2f2afd59845c234d27a68e5d1c8
I20260806 11:51:44.613334 24332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59: Bootstrap starting.
I20260806 11:51:44.617103 24332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:44.618428 24332 log.cc:824] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:44.622362 24332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59: No bootstrap required, opened a new log
Aug 06 11:51:44 dist-test-slave-7z32 krb5kdc[24223](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 11:51:44.626554 24332 raft_consensus.cc:348] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799cee62d32a4a04af808b39b951eb59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38299 } }
I20260806 11:51:44.627017 24332 raft_consensus.cc:374] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:44.627087 24332 raft_consensus.cc:729] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 799cee62d32a4a04af808b39b951eb59, State: Initialized, Role: FOLLOWER
I20260806 11:51:44.627751 24332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799cee62d32a4a04af808b39b951eb59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38299 } }
I20260806 11:51:44.627975 24332 raft_consensus.cc:388] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:44.628068 24332 raft_consensus.cc:482] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:44.628212 24332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:44.630071 24332 raft_consensus.cc:504] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799cee62d32a4a04af808b39b951eb59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38299 } }
I20260806 11:51:44.630582 24332 leader_election.cc:302] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 799cee62d32a4a04af808b39b951eb59; no voters:
I20260806 11:51:44.631130 24332 leader_election.cc:288] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:44.631513 24338 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:44.631865 24336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:44.608144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:53345 (local address 127.0.0.1:38299)
0806 11:51:44.608917 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:44.608941 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:44.611387 (+ 2446us) server_negotiation.cc:407] Connection header received
0806 11:51:44.612549 (+ 1162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:44.612592 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:44.613151 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:44.613637 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:44.615578 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:44.617067 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:44.618676 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:44.619528 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:44.619768 (+ 240us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:44.623812 (+ 4044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:44.623820 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:44.623841 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:44.623879 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:44.626659 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:44.627717 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:44.627726 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:44.627734 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:44.627970 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:44.628625 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:44.628630 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:44.628632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:44.629324 (+ 692us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:44.629616 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:44.630018 (+ 402us) server_negotiation.cc:299] Negotiation successful
0806 11:51:44.630379 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":222,"threads_started":1}
I20260806 11:51:44.631994 24338 raft_consensus.cc:686] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [term 1 LEADER]: Becoming Leader. State: Replica: 799cee62d32a4a04af808b39b951eb59, State: Running, Role: LEADER
I20260806 11:51:44.632828 24332 sys_catalog.cc:564] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:44.633342 24338 consensus_queue.cc:237] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799cee62d32a4a04af808b39b951eb59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38299 } }
I20260806 11:51:44.635339 24338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 799cee62d32a4a04af808b39b951eb59. Latest consensus state: current_term: 1 leader_uuid: "799cee62d32a4a04af808b39b951eb59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799cee62d32a4a04af808b39b951eb59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38299 } } }
I20260806 11:51:44.635510 24338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:44.636198 24356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:44.636466 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:44.636973 24340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "799cee62d32a4a04af808b39b951eb59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "799cee62d32a4a04af808b39b951eb59" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38299 } } }
I20260806 11:51:44.637156 24340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:44.641351 24356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:44.651258 24356 catalog_manager.cc:1347] Generated new cluster ID: 7f82ec498da3440ebb5f08ddd9082fb7
I20260806 11:51:44.651369 24356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:44.652045 24336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:44.639764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:52411 (local address 127.0.0.1:38299)
0806 11:51:44.639904 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:44.639909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:44.640701 (+ 792us) server_negotiation.cc:407] Connection header received
0806 11:51:44.640910 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:44.640914 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:44.640987 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:44.641112 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:44.642266 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:44.643147 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:44.644596 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:44.644963 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:44.645105 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:44.647410 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:44.647414 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:44.647419 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:44.647462 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:44.649344 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:44.649997 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:44.650003 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:44.650010 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:44.650097 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:44.650474 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:44.650484 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:44.650486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:44.650762 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:44.651660 (+ 898us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:44.651762 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 11:51:44.651877 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 11:51:44.665130 24356 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:44.666581 24356 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:44.673205 24356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 799cee62d32a4a04af808b39b951eb59: Generated new TSK 0
I20260806 11:51:44.674358 24356 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:44.679260 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 24237
W20260806 11:51:44.695660 24220 connection.cc:535] client connection to 127.0.0.1:38299 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38299): Connection reset by peer (error 104)
2026-08-06T11:51:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1819 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:44 dist-test-slave-7z32 krb5kdc[24378](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:44 dist-test-slave-7z32 krb5kdc[24378](info): set up 2 sockets
Aug 06 11:51:44 dist-test-slave-7z32 krb5kdc[24378](info): commencing operation
krb5kdc: starting...
W20260806 11:51:45.983714 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.004s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:46 dist-test-slave-7z32 krb5kdc[24378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:46.152388 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45311
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:46.281777 24393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:46.282160 24393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:46.282245 24393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:46.286515 24393 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:46.286645 24393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:46.286684 24393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:46.286726 24393 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:46.286764 24393 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:46.292497 24393 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45311
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:46.293972 24393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:46.295408 24393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:46.306903 24401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:46.306913 24398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:46.307135 24393 server_base.cc:1034] running on GCE node
W20260806 11:51:46.306936 24399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:46.308651 24393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:46.310681 24393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:46.311931 24393 hybrid_clock.cc:648] HybridClock initialized: now 1786017106311901 us; error 56 us; skew 500 ppm
Aug 06 11:51:46 dist-test-slave-7z32 krb5kdc[24378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017106, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:46.320346 24393 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:46.321988 24393 webserver.cc:460] Webserver started at http://127.0.0.1:44837/ using document root <none> and password file <none>
I20260806 11:51:46.322875 24393 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:46.323004 24393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:46.323323 24393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:46.326114 24393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "db2281f0f87a4e5d9e9813d6c0d00fed"
format_stamp: "Formatted at 2026-08-06 11:51:46 on dist-test-slave-7z32"
server_key: "5dd902a4b34a85581f4384b4ddfc0974"
server_key_iv: "c404ea9e3bade018bb45db79efbdffdf"
server_key_version: "encryptionkey@0"
I20260806 11:51:46.326882 24393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "db2281f0f87a4e5d9e9813d6c0d00fed"
format_stamp: "Formatted at 2026-08-06 11:51:46 on dist-test-slave-7z32"
server_key: "5dd902a4b34a85581f4384b4ddfc0974"
server_key_iv: "c404ea9e3bade018bb45db79efbdffdf"
server_key_version: "encryptionkey@0"
I20260806 11:51:46.332624 24393 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260806 11:51:46.336588 24409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:46.339402 24393 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260806 11:51:46.339746 24393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "db2281f0f87a4e5d9e9813d6c0d00fed"
format_stamp: "Formatted at 2026-08-06 11:51:46 on dist-test-slave-7z32"
server_key: "5dd902a4b34a85581f4384b4ddfc0974"
server_key_iv: "c404ea9e3bade018bb45db79efbdffdf"
server_key_version: "encryptionkey@0"
I20260806 11:51:46.339949 24393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:46.371994 24393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:46.375994 24393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:46.376209 24393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:46.385650 24393 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45311
I20260806 11:51:46.385738 24481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45311 every 8 connection(s)
I20260806 11:51:46.386997 24393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:46.390955 24482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:46.394387 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 24393
I20260806 11:51:46.394583 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:46.395000 27315 external_mini_cluster.cc:1428] Setting key 77f3288e9960af723569ae9ef7d6235e
I20260806 11:51:46.399042 24482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed: Bootstrap starting.
I20260806 11:51:46.402876 24482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:46.404023 24482 log.cc:824] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:46.407809 24482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed: No bootstrap required, opened a new log
I20260806 11:51:46.407995 24486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:46.397071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:41139 (local address 127.0.0.1:45311)
0806 11:51:46.397642 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:46.397662 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:46.397707 (+ 45us) server_negotiation.cc:407] Connection header received
0806 11:51:46.398723 (+ 1016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:46.398748 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:46.399346 (+ 598us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:46.399708 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:46.400134 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:46.401301 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:46.402756 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:46.403531 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:46.403686 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:46.405063 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:46.405072 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:46.405095 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:46.405757 (+ 662us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:46.405888 (+ 131us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:46.405923 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:46.406057 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:46.406452 (+ 395us) server_negotiation.cc:299] Negotiation successful
0806 11:51:46.406645 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":187,"threads_started":1}
I20260806 11:51:46.413578 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:46.413390 24482 raft_consensus.cc:348] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2281f0f87a4e5d9e9813d6c0d00fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } }
I20260806 11:51:46.413739 24482 raft_consensus.cc:374] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:46.413798 24482 raft_consensus.cc:729] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db2281f0f87a4e5d9e9813d6c0d00fed, State: Initialized, Role: FOLLOWER
I20260806 11:51:46.414403 24482 consensus_queue.cc:260] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2281f0f87a4e5d9e9813d6c0d00fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } }
I20260806 11:51:46.414592 24482 raft_consensus.cc:388] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:46.414662 24482 raft_consensus.cc:482] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:46.414788 24482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:46.416481 24482 raft_consensus.cc:504] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2281f0f87a4e5d9e9813d6c0d00fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } }
I20260806 11:51:46.416977 24482 leader_election.cc:302] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db2281f0f87a4e5d9e9813d6c0d00fed; no voters:
I20260806 11:51:46.417420 24482 leader_election.cc:288] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:46.417567 24496 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:46.417930 24496 raft_consensus.cc:686] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [term 1 LEADER]: Becoming Leader. State: Replica: db2281f0f87a4e5d9e9813d6c0d00fed, State: Running, Role: LEADER
I20260806 11:51:46.418494 24496 consensus_queue.cc:237] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2281f0f87a4e5d9e9813d6c0d00fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } }
I20260806 11:51:46.419209 24482 sys_catalog.cc:564] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:46.420665 24496 sys_catalog.cc:455] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [sys.catalog]: SysCatalogTable state changed. Reason: New leader db2281f0f87a4e5d9e9813d6c0d00fed. Latest consensus state: current_term: 1 leader_uuid: "db2281f0f87a4e5d9e9813d6c0d00fed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2281f0f87a4e5d9e9813d6c0d00fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } } }
I20260806 11:51:46.420847 24496 sys_catalog.cc:458] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:46.430600 24498 sys_catalog.cc:455] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db2281f0f87a4e5d9e9813d6c0d00fed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2281f0f87a4e5d9e9813d6c0d00fed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } } }
I20260806 11:51:46.430912 24498 sys_catalog.cc:458] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed [sys.catalog]: This master's current role is: LEADER
W20260806 11:51:46.430979 24518 catalog_manager.cc:1558] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:46.431062 24518 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:46.431160 24512 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:46.432327 24512 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:46.433138 24486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:46.416741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:56603 (local address 127.0.0.1:45311)
0806 11:51:46.423007 (+ 6266us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:46.423013 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:46.423037 (+ 24us) server_negotiation.cc:407] Connection header received
0806 11:51:46.423125 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:46.423132 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:46.423210 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:46.423345 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:46.424108 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:46.425027 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:46.426362 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:46.426739 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:46.426882 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:46.432054 (+ 5172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:46.432060 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:46.432063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:46.432083 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:46.432128 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:46.432144 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:46.432239 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:46.432833 (+ 594us) server_negotiation.cc:299] Negotiation successful
0806 11:51:46.432892 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6124}
I20260806 11:51:46.440805 24512 catalog_manager.cc:1347] Generated new cluster ID: 20399e04c4054e54b583f05588738e0f
I20260806 11:51:46.441167 24512 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:46.471068 24512 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:46.473167 24512 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:46.487913 24512 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db2281f0f87a4e5d9e9813d6c0d00fed: Generated new TSK 0
I20260806 11:51:46.488972 24512 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:46.498215 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 24393
W20260806 11:51:46.515539 24376 connection.cc:535] client connection to 127.0.0.1:45311 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45311): Connection reset by peer (error 104)
2026-08-06T11:51:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1820 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:46 dist-test-slave-7z32 krb5kdc[24531](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:46 dist-test-slave-7z32 krb5kdc[24531](info): set up 2 sockets
Aug 06 11:51:46 dist-test-slave-7z32 krb5kdc[24531](info): commencing operation
krb5kdc: starting...
W20260806 11:51:47.778730 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.001s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:47 dist-test-slave-7z32 krb5kdc[24531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017107, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 11:51:47.943607 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44845
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:48.088430 24558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:48.088902 24558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:48.088989 24558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:48.093768 24558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:48.093914 24558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:48.093956 24558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:48.094000 24558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:48.094045 24558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:48.100627 24558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44845
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:48.102397 24558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:48.103899 24558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:48.115132 24566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:48.115236 24568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:48.115370 24558 server_base.cc:1034] running on GCE node
W20260806 11:51:48.115132 24565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:48.116372 24558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:48.117820 24558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:48.119004 24558 hybrid_clock.cc:648] HybridClock initialized: now 1786017108118971 us; error 52 us; skew 500 ppm
Aug 06 11:51:48 dist-test-slave-7z32 krb5kdc[24531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017108, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:48.122555 24558 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 11:51:48.123907 24558 webserver.cc:460] Webserver started at http://127.0.0.1:43489/ using document root <none> and password file <none>
I20260806 11:51:48.124606 24558 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:48.124679 24558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:48.124882 24558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:48.127488 24558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "bc412b5637e34fb29b49ed31ae6c032f"
format_stamp: "Formatted at 2026-08-06 11:51:48 on dist-test-slave-7z32"
server_key: "700e9222eb35b06ac343e23570a50bbf"
server_key_iv: "60aa15c9793a1bd14d2b4450756dec23"
server_key_version: "encryptionkey@0"
I20260806 11:51:48.128122 24558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "bc412b5637e34fb29b49ed31ae6c032f"
format_stamp: "Formatted at 2026-08-06 11:51:48 on dist-test-slave-7z32"
server_key: "700e9222eb35b06ac343e23570a50bbf"
server_key_iv: "60aa15c9793a1bd14d2b4450756dec23"
server_key_version: "encryptionkey@0"
I20260806 11:51:48.133045 24558 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260806 11:51:48.136380 24577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:48.138134 24558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 11:51:48.138306 24558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "bc412b5637e34fb29b49ed31ae6c032f"
format_stamp: "Formatted at 2026-08-06 11:51:48 on dist-test-slave-7z32"
server_key: "700e9222eb35b06ac343e23570a50bbf"
server_key_iv: "60aa15c9793a1bd14d2b4450756dec23"
server_key_version: "encryptionkey@0"
I20260806 11:51:48.138434 24558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:48.143803 24558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:48.148012 24558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:48.148267 24558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:48.158056 24558 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44845
I20260806 11:51:48.158107 24650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44845 every 8 connection(s)
I20260806 11:51:48.159319 24558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:48.163718 24651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:48.164669 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 24558
I20260806 11:51:48.164887 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:48.165277 27315 external_mini_cluster.cc:1428] Setting key 5a24b808c11f9a40e969c81f5a8f2195
I20260806 11:51:48.173251 24661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:48.167305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:49813 (local address 127.0.0.1:44845)
0806 11:51:48.167969 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:48.167998 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:48.168065 (+ 67us) server_negotiation.cc:407] Connection header received
0806 11:51:48.169105 (+ 1040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:48.169150 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:48.169644 (+ 494us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:48.170327 (+ 683us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:48.171317 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:48.171324 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:48.171344 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:48.171357 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:48.171428 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:48.171458 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:48.171685 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:48.171789 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 11:51:48.172022 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":183,"threads_started":1}
I20260806 11:51:48.173727 24651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f: Bootstrap starting.
I20260806 11:51:48.177217 24651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:48.177664 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:48.178323 24651 log.cc:824] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:48.181672 24651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f: No bootstrap required, opened a new log
I20260806 11:51:48.182785 24661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:48.180623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:47293 (local address 127.0.0.1:44845)
0806 11:51:48.180801 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:48.180808 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:48.181085 (+ 277us) server_negotiation.cc:407] Connection header received
0806 11:51:48.181280 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:48.181284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:48.181330 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:48.181428 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:48.182311 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:48.182315 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:48.182318 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:48.182330 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:48.182365 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:48.182377 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:48.182480 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:48.182565 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 11:51:48.182620 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 11:51:48.186568 24651 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc412b5637e34fb29b49ed31ae6c032f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44845 } }
I20260806 11:51:48.186986 24651 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:48.187081 24651 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc412b5637e34fb29b49ed31ae6c032f, State: Initialized, Role: FOLLOWER
I20260806 11:51:48.187677 24651 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc412b5637e34fb29b49ed31ae6c032f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44845 } }
I20260806 11:51:48.187875 24651 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:48.187968 24651 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:48.188090 24651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:48.189464 24651 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc412b5637e34fb29b49ed31ae6c032f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44845 } }
I20260806 11:51:48.189931 24651 leader_election.cc:302] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc412b5637e34fb29b49ed31ae6c032f; no voters:
I20260806 11:51:48.190356 24651 leader_election.cc:288] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:48.190711 24670 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:48.191155 24670 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [term 1 LEADER]: Becoming Leader. State: Replica: bc412b5637e34fb29b49ed31ae6c032f, State: Running, Role: LEADER
I20260806 11:51:48.191605 24670 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc412b5637e34fb29b49ed31ae6c032f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44845 } }
I20260806 11:51:48.192215 24651 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:48.193943 24674 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc412b5637e34fb29b49ed31ae6c032f. Latest consensus state: current_term: 1 leader_uuid: "bc412b5637e34fb29b49ed31ae6c032f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc412b5637e34fb29b49ed31ae6c032f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44845 } } }
I20260806 11:51:48.194124 24674 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:48.194044 24673 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc412b5637e34fb29b49ed31ae6c032f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc412b5637e34fb29b49ed31ae6c032f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44845 } } }
I20260806 11:51:48.194222 24673 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:48.194595 24682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:48.198195 24682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:48.205258 24682 catalog_manager.cc:1347] Generated new cluster ID: a05137b6a38449fa87b29e504895e1c5
I20260806 11:51:48.205377 24682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:48.221712 24682 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:48.222307 24682 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:48.234241 24682 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc412b5637e34fb29b49ed31ae6c032f: Generated new TSK 0
I20260806 11:51:48.235368 24682 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:48.247795 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 24558
2026-08-06T11:51:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1749 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:48 dist-test-slave-7z32 krb5kdc[24694](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:48 dist-test-slave-7z32 krb5kdc[24694](info): set up 2 sockets
Aug 06 11:51:48 dist-test-slave-7z32 krb5kdc[24694](info): commencing operation
krb5kdc: starting...
W20260806 11:51:49.520965 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:49 dist-test-slave-7z32 krb5kdc[24694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:51:49.691020 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40689
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:36237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:40689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:49.825445 24715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:49.825785 24715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:49.825832 24715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:49.830044 24715 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:49.830127 24715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:49.830147 24715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:49.830165 24715 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:49.830183 24715 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:49.835994 24715 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:36237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:40689
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:40689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:49.837289 24715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:49.838474 24715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:49.848794 24729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:49.848793 24726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:49.848839 24733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:49.849300 24715 server_base.cc:1034] running on GCE node
I20260806 11:51:49.850211 24715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:49.851812 24715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:49.853066 24715 hybrid_clock.cc:648] HybridClock initialized: now 1786017109853026 us; error 64 us; skew 500 ppm
Aug 06 11:51:49 dist-test-slave-7z32 krb5kdc[24694](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017109, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:49.857862 24715 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:51:49.859294 24715 webserver.cc:460] Webserver started at http://127.26.172.254:46333/ using document root <none> and password file <none>
I20260806 11:51:49.860016 24715 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:49.860128 24715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:49.860427 24715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:49.863003 24715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "5666c2ba117a4688ba89d877c16a7f06"
format_stamp: "Formatted at 2026-08-06 11:51:49 on dist-test-slave-7z32"
server_key: "bfedf68c15a24dec180125cec03f431d"
server_key_iv: "2b229a52f38079b2ed57a8b1dc0b2974"
server_key_version: "encryptionkey@0"
I20260806 11:51:49.863668 24715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "5666c2ba117a4688ba89d877c16a7f06"
format_stamp: "Formatted at 2026-08-06 11:51:49 on dist-test-slave-7z32"
server_key: "bfedf68c15a24dec180125cec03f431d"
server_key_iv: "2b229a52f38079b2ed57a8b1dc0b2974"
server_key_version: "encryptionkey@0"
I20260806 11:51:49.868414 24715 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:49.871884 24741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:49.873813 24715 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:51:49.874035 24715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "5666c2ba117a4688ba89d877c16a7f06"
format_stamp: "Formatted at 2026-08-06 11:51:49 on dist-test-slave-7z32"
server_key: "bfedf68c15a24dec180125cec03f431d"
server_key_iv: "2b229a52f38079b2ed57a8b1dc0b2974"
server_key_version: "encryptionkey@0"
I20260806 11:51:49.874207 24715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:49.890973 24715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:49.895200 24715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:49.895480 24715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:49.905444 24715 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:40689
I20260806 11:51:49.905658 24810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:40689 every 8 connection(s)
I20260806 11:51:49.906862 24715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:49.911083 24813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:49.912864 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 24715
I20260806 11:51:49.913041 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:49.913407 27315 external_mini_cluster.cc:1428] Setting key 95c7dca63f8867c6322b0fe4ea156937
I20260806 11:51:49.920859 24813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06: Bootstrap starting.
I20260806 11:51:49.925091 24813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06: Neither blocks nor log segments found. Creating new log.
Aug 06 11:51:49 dist-test-slave-7z32 krb5kdc[24694](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:49.926540 24813 log.cc:824] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:49.930001 24813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06: No bootstrap required, opened a new log
I20260806 11:51:49.934036 24816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:49.915527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41589 (local address 127.26.172.254:40689)
0806 11:51:49.916113 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:49.916132 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:49.916175 (+ 43us) server_negotiation.cc:407] Connection header received
0806 11:51:49.917125 (+ 950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:49.917157 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:49.917594 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:49.917946 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:49.919503 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:49.920675 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:49.922099 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:49.922764 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:49.923050 (+ 286us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:49.927151 (+ 4101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:49.927185 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:49.927216 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:49.927275 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:49.929695 (+ 2420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:49.930531 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:49.930538 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:49.930544 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:49.930694 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:49.931177 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:49.931181 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:49.931182 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:49.931822 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:49.932120 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:49.932668 (+ 548us) server_negotiation.cc:299] Negotiation successful
0806 11:51:49.933023 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":207,"threads_started":1}
I20260806 11:51:49.935583 24813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5666c2ba117a4688ba89d877c16a7f06" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40689 } }
I20260806 11:51:49.935961 24813 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:49.936048 24813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5666c2ba117a4688ba89d877c16a7f06, State: Initialized, Role: FOLLOWER
I20260806 11:51:49.936597 24813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5666c2ba117a4688ba89d877c16a7f06" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40689 } }
I20260806 11:51:49.936780 24813 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:49.936885 24813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:49.937002 24813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:49.938494 24813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5666c2ba117a4688ba89d877c16a7f06" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40689 } }
I20260806 11:51:49.938709 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:49.939004 24813 leader_election.cc:302] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5666c2ba117a4688ba89d877c16a7f06; no voters:
I20260806 11:51:49.939431 24813 leader_election.cc:288] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:49.939646 24819 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:49.940016 24819 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [term 1 LEADER]: Becoming Leader. State: Replica: 5666c2ba117a4688ba89d877c16a7f06, State: Running, Role: LEADER
I20260806 11:51:49.940550 24819 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5666c2ba117a4688ba89d877c16a7f06" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40689 } }
I20260806 11:51:49.941322 24813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:49.943203 24820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5666c2ba117a4688ba89d877c16a7f06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5666c2ba117a4688ba89d877c16a7f06" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40689 } } }
I20260806 11:51:49.943373 24820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:49.943791 24822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5666c2ba117a4688ba89d877c16a7f06. Latest consensus state: current_term: 1 leader_uuid: "5666c2ba117a4688ba89d877c16a7f06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5666c2ba117a4688ba89d877c16a7f06" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 40689 } } }
I20260806 11:51:49.943917 24822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06 [sys.catalog]: This master's current role is: LEADER
W20260806 11:51:49.948266 24851 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:49.948376 24851 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:49.948534 24841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:49.949955 24841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:49.953016 24816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:49.941966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51751 (local address 127.26.172.254:40689)
0806 11:51:49.942098 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:49.942113 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:49.942132 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:51:49.942188 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:49.942193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:49.942262 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:49.942381 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:49.943614 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:49.944498 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:49.945796 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:49.946192 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:49.946320 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:49.948688 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:49.948692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:49.948694 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:49.948721 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:49.950564 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:49.951286 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:49.951290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:49.951292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:49.951392 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:49.951770 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:49.951773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:49.951775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:49.952003 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:49.952187 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:49.952497 (+ 310us) server_negotiation.cc:299] Negotiation successful
0806 11:51:49.952631 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 11:51:49.957818 24841 catalog_manager.cc:1347] Generated new cluster ID: 63f0aab98718477baf8f5aa4ef3a807a
I20260806 11:51:49.957964 24841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:49.984202 24841 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:49.985751 24841 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:49.994270 24841 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5666c2ba117a4688ba89d877c16a7f06: Generated new TSK 0
I20260806 11:51:49.995298 24841 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:50.012928 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 24715
W20260806 11:51:50.030949 24692 connection.cc:535] client connection to 127.26.172.254:40689 recv error: Network error: failed to read from TLS socket (remote: 127.26.172.254:40689): Connection reset by peer (error 104)
2026-08-06T11:51:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1765 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:50 dist-test-slave-7z32 krb5kdc[24858](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:50 dist-test-slave-7z32 krb5kdc[24858](info): set up 2 sockets
Aug 06 11:51:50 dist-test-slave-7z32 krb5kdc[24858](info): commencing operation
krb5kdc: starting...
W20260806 11:51:51.319877 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.001s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:51 dist-test-slave-7z32 krb5kdc[24858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:51:51.483273 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:33899
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:33899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:51.628293 24876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:51.628739 24876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:51.628823 24876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:51.633630 24876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:51.633769 24876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:51.633809 24876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:51.633853 24876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:51.633886 24876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:51.640479 24876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:33899
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:33899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:51.642130 24876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:51.643575 24876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:51.654696 24889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:51.654698 24886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:51.654740 24887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:51.655309 24876 server_base.cc:1034] running on GCE node
I20260806 11:51:51.656217 24876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:51.657713 24876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:51.659054 24876 hybrid_clock.cc:648] HybridClock initialized: now 1786017111659002 us; error 75 us; skew 500 ppm
Aug 06 11:51:51 dist-test-slave-7z32 krb5kdc[24858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017111, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:51.669766 24876 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:51:51.671036 24876 webserver.cc:460] Webserver started at http://127.26.172.254:43785/ using document root <none> and password file <none>
I20260806 11:51:51.671689 24876 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:51.671761 24876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:51.671972 24876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:51.674443 24876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "164999a310774dd4972574abe80c5f76"
format_stamp: "Formatted at 2026-08-06 11:51:51 on dist-test-slave-7z32"
server_key: "301f541dc81e3329e91e79d90b19268e"
server_key_iv: "6691ec81bfac099932cb3db0d415738c"
server_key_version: "encryptionkey@0"
I20260806 11:51:51.675146 24876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "164999a310774dd4972574abe80c5f76"
format_stamp: "Formatted at 2026-08-06 11:51:51 on dist-test-slave-7z32"
server_key: "301f541dc81e3329e91e79d90b19268e"
server_key_iv: "6691ec81bfac099932cb3db0d415738c"
server_key_version: "encryptionkey@0"
I20260806 11:51:51.679881 24876 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:51:51.682998 24897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:51.684671 24876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 11:51:51.684880 24876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "164999a310774dd4972574abe80c5f76"
format_stamp: "Formatted at 2026-08-06 11:51:51 on dist-test-slave-7z32"
server_key: "301f541dc81e3329e91e79d90b19268e"
server_key_iv: "6691ec81bfac099932cb3db0d415738c"
server_key_version: "encryptionkey@0"
I20260806 11:51:51.685029 24876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:51.700309 24876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:51.704514 24876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:51.704720 24876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:51.714478 24876 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:33899
I20260806 11:51:51.714623 24969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:33899 every 8 connection(s)
I20260806 11:51:51.715740 24876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:51.719976 24970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:51.724153 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 24876
I20260806 11:51:51.724314 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:51.724669 27315 external_mini_cluster.cc:1428] Setting key 1a357e37e2341903c33453f321330ca4
I20260806 11:51:51.728701 24970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76: Bootstrap starting.
I20260806 11:51:51.732523 24970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:51.733750 24970 log.cc:824] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:51.736866 24976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:51.726748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35185 (local address 127.26.172.254:33899)
0806 11:51:51.727379 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:51.727399 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:51.727442 (+ 43us) server_negotiation.cc:407] Connection header received
0806 11:51:51.728300 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:51.728322 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:51.728723 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:51.729119 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:51.729699 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:51.730947 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:51.732343 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:51.732981 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:51.733147 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:51.734470 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:51.734478 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:51.734501 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:51.735217 (+ 716us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:51.735288 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:51.735316 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:51.735443 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:51.735789 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 11:51:51.735988 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":203,"threads_started":1}
I20260806 11:51:51.736970 24970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76: No bootstrap required, opened a new log
I20260806 11:51:51.741115 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:51.742331 24970 raft_consensus.cc:348] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164999a310774dd4972574abe80c5f76" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33899 } }
I20260806 11:51:51.742739 24970 raft_consensus.cc:374] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:51.742812 24970 raft_consensus.cc:729] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164999a310774dd4972574abe80c5f76, State: Initialized, Role: FOLLOWER
I20260806 11:51:51.743418 24970 consensus_queue.cc:260] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164999a310774dd4972574abe80c5f76" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33899 } }
I20260806 11:51:51.743624 24970 raft_consensus.cc:388] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:51.743719 24970 raft_consensus.cc:482] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:51.743851 24970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:51.745146 24970 raft_consensus.cc:504] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164999a310774dd4972574abe80c5f76" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33899 } }
I20260806 11:51:51.745645 24970 leader_election.cc:302] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 164999a310774dd4972574abe80c5f76; no voters:
I20260806 11:51:51.746062 24970 leader_election.cc:288] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:51.746248 24985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:51.746601 24985 raft_consensus.cc:686] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [term 1 LEADER]: Becoming Leader. State: Replica: 164999a310774dd4972574abe80c5f76, State: Running, Role: LEADER
I20260806 11:51:51.747144 24985 consensus_queue.cc:237] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164999a310774dd4972574abe80c5f76" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33899 } }
I20260806 11:51:51.747997 24970 sys_catalog.cc:564] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:51.749274 24986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "164999a310774dd4972574abe80c5f76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164999a310774dd4972574abe80c5f76" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33899 } } }
I20260806 11:51:51.749431 24986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:51.749716 24976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:51.743677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51579 (local address 127.26.172.254:33899)
0806 11:51:51.743889 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:51.743895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:51.744171 (+ 276us) server_negotiation.cc:407] Connection header received
0806 11:51:51.744339 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:51.744342 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:51.744396 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:51.744491 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:51.744797 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:51.745381 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:51.746535 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:51.746927 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:51.747029 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:51.748672 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:51.748677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:51.748681 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:51.748702 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:51.748753 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:51.748774 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:51.748912 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:51.749436 (+ 524us) server_negotiation.cc:299] Negotiation successful
0806 11:51:51.749494 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 11:51:51.749979 24987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 164999a310774dd4972574abe80c5f76. Latest consensus state: current_term: 1 leader_uuid: "164999a310774dd4972574abe80c5f76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "164999a310774dd4972574abe80c5f76" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 33899 } } }
I20260806 11:51:51.750079 24987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76 [sys.catalog]: This master's current role is: LEADER
W20260806 11:51:51.755523 25005 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:51.755679 25005 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:51.755790 24994 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:51.756897 24994 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:51.764698 24994 catalog_manager.cc:1347] Generated new cluster ID: 96129eee1fa94876a48f0166dee6ea26
I20260806 11:51:51.764819 24994 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:51.778057 24994 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:51.779681 24994 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:51.786381 24994 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 164999a310774dd4972574abe80c5f76: Generated new TSK 0
I20260806 11:51:51.787333 24994 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:51.799151 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 24876
W20260806 11:51:51.815114 24856 connection.cc:535] client connection to 127.26.172.254:33899 recv error: Network error: failed to read from TLS socket (remote: 127.26.172.254:33899): Connection reset by peer (error 104)
2026-08-06T11:51:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1784 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:51 dist-test-slave-7z32 krb5kdc[25011](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:51 dist-test-slave-7z32 krb5kdc[25011](info): set up 2 sockets
Aug 06 11:51:51 dist-test-slave-7z32 krb5kdc[25011](info): commencing operation
krb5kdc: starting...
W20260806 11:51:53.123306 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.004s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:53 dist-test-slave-7z32 krb5kdc[25011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:51:53.291715 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:45061
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:40287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:45061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:53.428645 25026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:53.429015 25026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:53.429068 25026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:53.433868 25026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:53.433974 25026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:53.433997 25026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:53.434016 25026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:53.434036 25026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:53.440526 25026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:40287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:45061
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:45061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:53.441787 25026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:53.443053 25026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:53.453732 25038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:53.453727 25034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:53.453783 25026 server_base.cc:1034] running on GCE node
W20260806 11:51:53.453720 25033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:53.454746 25026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:53.456272 25026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:53.457513 25026 hybrid_clock.cc:648] HybridClock initialized: now 1786017113457462 us; error 68 us; skew 500 ppm
Aug 06 11:51:53 dist-test-slave-7z32 krb5kdc[25011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017113, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:53.461205 25026 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:51:53.462355 25026 webserver.cc:460] Webserver started at http://127.26.172.254:43995/ using document root <none> and password file <none>
I20260806 11:51:53.463058 25026 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:53.463140 25026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:53.463335 25026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:53.465585 25026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "f02aafc8a1ab4202a49b07d739598753"
format_stamp: "Formatted at 2026-08-06 11:51:53 on dist-test-slave-7z32"
server_key: "323f5438f04daa66a3aab1655a2acbc1"
server_key_iv: "d59affee3c1c4c0a2d23c92e3d0a7ce7"
server_key_version: "encryptionkey@0"
I20260806 11:51:53.466172 25026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "f02aafc8a1ab4202a49b07d739598753"
format_stamp: "Formatted at 2026-08-06 11:51:53 on dist-test-slave-7z32"
server_key: "323f5438f04daa66a3aab1655a2acbc1"
server_key_iv: "d59affee3c1c4c0a2d23c92e3d0a7ce7"
server_key_version: "encryptionkey@0"
I20260806 11:51:53.470940 25026 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260806 11:51:53.474082 25050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:53.475792 25026 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 11:51:53.475956 25026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "f02aafc8a1ab4202a49b07d739598753"
format_stamp: "Formatted at 2026-08-06 11:51:53 on dist-test-slave-7z32"
server_key: "323f5438f04daa66a3aab1655a2acbc1"
server_key_iv: "d59affee3c1c4c0a2d23c92e3d0a7ce7"
server_key_version: "encryptionkey@0"
I20260806 11:51:53.476070 25026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:53.481474 25026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:53.485260 25026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:53.485442 25026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:53.494310 25026 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:45061
I20260806 11:51:53.494478 25120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:45061 every 8 connection(s)
I20260806 11:51:53.495530 25026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:53.499754 25121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:53.503158 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 25026
I20260806 11:51:53.503340 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:53.503675 27315 external_mini_cluster.cc:1428] Setting key 18157e12da67804c89809b4f7000e1eb
I20260806 11:51:53.507867 25121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753: Bootstrap starting.
I20260806 11:51:53.510356 25124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:53.505438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35315 (local address 127.26.172.254:45061)
0806 11:51:53.506153 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:53.506179 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:53.506236 (+ 57us) server_negotiation.cc:407] Connection header received
0806 11:51:53.507228 (+ 992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:53.507252 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:53.507643 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:53.508057 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:53.508972 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:53.508977 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:53.508991 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:53.509008 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:53.509067 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:53.509088 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:53.509268 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:53.509344 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 11:51:53.509522 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":204,"threads_started":1}
I20260806 11:51:53.511355 25121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:53.512552 25121 log.cc:824] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:53.514592 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:53.515872 25121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753: No bootstrap required, opened a new log
I20260806 11:51:53.520468 25124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:53.518037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59845 (local address 127.26.172.254:45061)
0806 11:51:53.518248 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:53.518266 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:53.518538 (+ 272us) server_negotiation.cc:407] Connection header received
0806 11:51:53.518708 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:53.518712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:53.518763 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:53.518987 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:53.519889 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:53.519892 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:53.519895 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:53.519907 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:53.519939 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:53.519950 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:53.520050 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:53.520177 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 11:51:53.520249 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 11:51:53.521973 25121 raft_consensus.cc:348] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02aafc8a1ab4202a49b07d739598753" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45061 } }
I20260806 11:51:53.522286 25121 raft_consensus.cc:374] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:53.522334 25121 raft_consensus.cc:729] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f02aafc8a1ab4202a49b07d739598753, State: Initialized, Role: FOLLOWER
I20260806 11:51:53.522800 25121 consensus_queue.cc:260] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02aafc8a1ab4202a49b07d739598753" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45061 } }
I20260806 11:51:53.523001 25121 raft_consensus.cc:388] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:53.523063 25121 raft_consensus.cc:482] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:53.523149 25121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:53.524258 25121 raft_consensus.cc:504] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02aafc8a1ab4202a49b07d739598753" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45061 } }
I20260806 11:51:53.524616 25121 leader_election.cc:302] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f02aafc8a1ab4202a49b07d739598753; no voters:
I20260806 11:51:53.524928 25121 leader_election.cc:288] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:53.525166 25134 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:53.525636 25134 raft_consensus.cc:686] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [term 1 LEADER]: Becoming Leader. State: Replica: f02aafc8a1ab4202a49b07d739598753, State: Running, Role: LEADER
I20260806 11:51:53.526077 25134 consensus_queue.cc:237] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02aafc8a1ab4202a49b07d739598753" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45061 } }
I20260806 11:51:53.526551 25121 sys_catalog.cc:564] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:53.528468 25136 sys_catalog.cc:455] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f02aafc8a1ab4202a49b07d739598753. Latest consensus state: current_term: 1 leader_uuid: "f02aafc8a1ab4202a49b07d739598753" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02aafc8a1ab4202a49b07d739598753" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45061 } } }
I20260806 11:51:53.528635 25136 sys_catalog.cc:458] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:53.528877 25135 sys_catalog.cc:455] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f02aafc8a1ab4202a49b07d739598753" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02aafc8a1ab4202a49b07d739598753" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 45061 } } }
I20260806 11:51:53.529001 25135 sys_catalog.cc:458] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:53.530161 25146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:53.533560 25146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:53.541379 25146 catalog_manager.cc:1347] Generated new cluster ID: cdc679ce9ed244879deb094021a7fd1a
I20260806 11:51:53.541561 25146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:53.571636 25146 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:53.572243 25146 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:53.585747 25146 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f02aafc8a1ab4202a49b07d739598753: Generated new TSK 0
I20260806 11:51:53.586941 25146 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:53.598804 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 25026
2026-08-06T11:51:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1800 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:53 dist-test-slave-7z32 krb5kdc[25159](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:53 dist-test-slave-7z32 krb5kdc[25159](info): set up 2 sockets
Aug 06 11:51:53 dist-test-slave-7z32 krb5kdc[25159](info): commencing operation
krb5kdc: starting...
W20260806 11:51:54.913159 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.005s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:55 dist-test-slave-7z32 krb5kdc[25159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:51:55.079924 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:36751
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:35229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:36751
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:55.226426 25175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:55.226894 25175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:55.226998 25175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:55.231637 25175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:55.231735 25175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:55.231757 25175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:55.231775 25175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:55.231792 25175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:55.238011 25175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:35229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:36751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:36751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:55.239696 25175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:55.241065 25175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:55.252545 25181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:55.252626 25180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:55.252556 25183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:55.253139 25175 server_base.cc:1034] running on GCE node
I20260806 11:51:55.253888 25175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:55.255406 25175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:55.256660 25175 hybrid_clock.cc:648] HybridClock initialized: now 1786017115256625 us; error 80 us; skew 500 ppm
Aug 06 11:51:55 dist-test-slave-7z32 krb5kdc[25159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017115, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:55.260499 25175 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:51:55.261682 25175 webserver.cc:460] Webserver started at http://127.26.172.254:35227/ using document root <none> and password file <none>
I20260806 11:51:55.262408 25175 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:55.262538 25175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:55.262881 25175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:55.265417 25175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "4c471333b08f4dcba3a827f92307afa2"
format_stamp: "Formatted at 2026-08-06 11:51:55 on dist-test-slave-7z32"
server_key: "273e979ee957704033cb7cc4a17522b3"
server_key_iv: "91e7fd30ef3ff9257a881992f54031ad"
server_key_version: "encryptionkey@0"
I20260806 11:51:55.266129 25175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "4c471333b08f4dcba3a827f92307afa2"
format_stamp: "Formatted at 2026-08-06 11:51:55 on dist-test-slave-7z32"
server_key: "273e979ee957704033cb7cc4a17522b3"
server_key_iv: "91e7fd30ef3ff9257a881992f54031ad"
server_key_version: "encryptionkey@0"
I20260806 11:51:55.271294 25175 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 11:51:55.274646 25193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:55.276609 25175 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:51:55.276818 25175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "4c471333b08f4dcba3a827f92307afa2"
format_stamp: "Formatted at 2026-08-06 11:51:55 on dist-test-slave-7z32"
server_key: "273e979ee957704033cb7cc4a17522b3"
server_key_iv: "91e7fd30ef3ff9257a881992f54031ad"
server_key_version: "encryptionkey@0"
I20260806 11:51:55.276978 25175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:55.302138 25175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:55.306613 25175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:55.306950 25175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:55.317054 25175 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:36751
I20260806 11:51:55.317121 25265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:36751 every 8 connection(s)
I20260806 11:51:55.318326 25175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:55.321552 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 25175
I20260806 11:51:55.321775 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:55.322193 27315 external_mini_cluster.cc:1428] Setting key 0d14bdb4c37d5a6a19e156ee8b5f0899
I20260806 11:51:55.323231 25267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:55.334743 25267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2: Bootstrap starting.
Aug 06 11:51:55 dist-test-slave-7z32 krb5kdc[25159](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:51:55.338201 25267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:55.339363 25267 log.cc:824] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:55.342458 25271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:55.324440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48387 (local address 127.26.172.254:36751)
0806 11:51:55.325271 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:55.325294 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:55.325351 (+ 57us) server_negotiation.cc:407] Connection header received
0806 11:51:55.326224 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:55.326247 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:55.326738 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:55.327363 (+ 625us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:55.328781 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:55.329964 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:55.331896 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:55.332541 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:55.332714 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:55.336557 (+ 3843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:55.336565 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:55.336584 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:55.336628 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:55.338780 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:55.339402 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:55.339408 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:55.339414 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:55.339598 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:55.339922 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:55.339926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:55.339928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:55.340631 (+ 703us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:55.340891 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:55.341216 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 11:51:55.341587 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":254,"threads_started":1}
I20260806 11:51:55.342725 25267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2: No bootstrap required, opened a new log
I20260806 11:51:55.346889 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:55.348567 25267 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c471333b08f4dcba3a827f92307afa2" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36751 } }
I20260806 11:51:55.348978 25267 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:55.349068 25267 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c471333b08f4dcba3a827f92307afa2, State: Initialized, Role: FOLLOWER
I20260806 11:51:55.349763 25267 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c471333b08f4dcba3a827f92307afa2" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36751 } }
I20260806 11:51:55.349984 25267 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:55.350062 25267 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:55.350208 25267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:55.352025 25267 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c471333b08f4dcba3a827f92307afa2" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36751 } }
I20260806 11:51:55.352586 25267 leader_election.cc:302] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c471333b08f4dcba3a827f92307afa2; no voters:
I20260806 11:51:55.353103 25267 leader_election.cc:288] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:55.353358 25280 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:55.354532 25280 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [term 1 LEADER]: Becoming Leader. State: Replica: 4c471333b08f4dcba3a827f92307afa2, State: Running, Role: LEADER
I20260806 11:51:55.355039 25267 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:55.355578 25280 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c471333b08f4dcba3a827f92307afa2" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36751 } }
I20260806 11:51:55.358450 25281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c471333b08f4dcba3a827f92307afa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c471333b08f4dcba3a827f92307afa2" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36751 } } }
I20260806 11:51:55.358678 25281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:55.359048 25282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c471333b08f4dcba3a827f92307afa2. Latest consensus state: current_term: 1 leader_uuid: "4c471333b08f4dcba3a827f92307afa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c471333b08f4dcba3a827f92307afa2" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36751 } } }
I20260806 11:51:55.359499 25282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2 [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:55.361645 25271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:55.349689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33655 (local address 127.26.172.254:36751)
0806 11:51:55.349847 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:55.349852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:55.350204 (+ 352us) server_negotiation.cc:407] Connection header received
0806 11:51:55.350502 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:55.350506 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:55.350573 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:55.350685 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:55.351695 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:55.352444 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:55.353748 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:55.354127 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:55.354238 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:55.356467 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:55.356474 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:55.356481 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:51:55.356524 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:55.358759 (+ 2235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:55.359588 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:55.359593 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:55.359595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:55.359712 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:51:55.360273 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:51:55.360277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:51:55.360280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:51:55.360661 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:55.360824 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:55.361273 (+ 449us) server_negotiation.cc:299] Negotiation successful
0806 11:51:55.361444 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260806 11:51:55.363547 25301 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:55.363686 25301 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:55.363866 25303 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:55.364878 25303 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:55.372658 25303 catalog_manager.cc:1347] Generated new cluster ID: 9dba7ffd75f34e0aaaf519a92969bbff
I20260806 11:51:55.372782 25303 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:55.395424 25303 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:55.396965 25303 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:55.408268 25303 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c471333b08f4dcba3a827f92307afa2: Generated new TSK 0
I20260806 11:51:55.409387 25303 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:55.418807 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 25175
2026-08-06T11:51:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1824 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:55 dist-test-slave-7z32 krb5kdc[25312](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:55 dist-test-slave-7z32 krb5kdc[25312](info): set up 2 sockets
Aug 06 11:51:55 dist-test-slave-7z32 krb5kdc[25312](info): commencing operation
krb5kdc: starting...
W20260806 11:51:56.751425 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.295s user 0.009s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:56 dist-test-slave-7z32 krb5kdc[25312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:51:56.923324 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:36571
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:35659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:36571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:57.078428 25332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:57.078974 25332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:57.079041 25332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:57.083822 25332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:57.083936 25332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:57.083958 25332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:57.083979 25332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:57.083997 25332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:57.090744 25332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:35659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:36571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:36571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:57.092458 25332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:57.093989 25332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 11:51:57.105965 25332 server_base.cc:1034] running on GCE node
W20260806 11:51:57.105883 25345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:57.105883 25338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:57.106215 25341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:57.107497 25332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:57.109282 25332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:57.110625 25332 hybrid_clock.cc:648] HybridClock initialized: now 1786017117110569 us; error 74 us; skew 500 ppm
Aug 06 11:51:57 dist-test-slave-7z32 krb5kdc[25312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017117, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:57.121227 25332 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:51:57.122709 25332 webserver.cc:460] Webserver started at http://127.26.172.254:46607/ using document root <none> and password file <none>
I20260806 11:51:57.123623 25332 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:57.123715 25332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:57.123961 25332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:57.126807 25332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "00e6db1ff1144a5daa73b1857ebdd91d"
format_stamp: "Formatted at 2026-08-06 11:51:57 on dist-test-slave-7z32"
server_key: "a1dd19818a78027496b24e0b92e57d2a"
server_key_iv: "b865685770f68c000e86f4a648533e8b"
server_key_version: "encryptionkey@0"
I20260806 11:51:57.127713 25332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "00e6db1ff1144a5daa73b1857ebdd91d"
format_stamp: "Formatted at 2026-08-06 11:51:57 on dist-test-slave-7z32"
server_key: "a1dd19818a78027496b24e0b92e57d2a"
server_key_iv: "b865685770f68c000e86f4a648533e8b"
server_key_version: "encryptionkey@0"
I20260806 11:51:57.134287 25332 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 11:51:57.137743 25356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:57.139729 25332 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:51:57.139928 25332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "00e6db1ff1144a5daa73b1857ebdd91d"
format_stamp: "Formatted at 2026-08-06 11:51:57 on dist-test-slave-7z32"
server_key: "a1dd19818a78027496b24e0b92e57d2a"
server_key_iv: "b865685770f68c000e86f4a648533e8b"
server_key_version: "encryptionkey@0"
I20260806 11:51:57.140108 25332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:57.164209 25332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:57.168346 25332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:57.168613 25332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:57.177810 25332 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:36571
I20260806 11:51:57.177892 25433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:36571 every 8 connection(s)
I20260806 11:51:57.179136 25332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:57.184434 25435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:57.185504 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 25332
I20260806 11:51:57.185761 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:57.186160 27315 external_mini_cluster.cc:1428] Setting key 8bf733aba052285ebc986421b8cf5700
I20260806 11:51:57.191726 25435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d: Bootstrap starting.
I20260806 11:51:57.194772 25435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:57.195858 25435 log.cc:824] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:57.199083 25435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d: No bootstrap required, opened a new log
I20260806 11:51:57.199412 25439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:57.188142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38729 (local address 127.26.172.254:36571)
0806 11:51:57.188761 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:57.188781 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:57.188830 (+ 49us) server_negotiation.cc:407] Connection header received
0806 11:51:57.189693 (+ 863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:57.189714 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:57.190189 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:57.190591 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:57.191127 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:57.192492 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:57.193889 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:57.194530 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:57.194702 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:57.196011 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:57.196022 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:57.196055 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:57.196920 (+ 865us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:57.197028 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:57.197074 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:57.197225 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:57.197556 (+ 331us) server_negotiation.cc:299] Negotiation successful
0806 11:51:57.197940 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":205,"threads_started":1}
I20260806 11:51:57.203738 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:57.203636 25435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6db1ff1144a5daa73b1857ebdd91d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36571 } }
I20260806 11:51:57.203999 25435 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:57.204048 25435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e6db1ff1144a5daa73b1857ebdd91d, State: Initialized, Role: FOLLOWER
I20260806 11:51:57.204569 25435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6db1ff1144a5daa73b1857ebdd91d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36571 } }
I20260806 11:51:57.204751 25435 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:57.204841 25435 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:57.204960 25435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:57.206352 25435 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6db1ff1144a5daa73b1857ebdd91d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36571 } }
I20260806 11:51:57.206828 25435 leader_election.cc:302] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00e6db1ff1144a5daa73b1857ebdd91d; no voters:
I20260806 11:51:57.207302 25435 leader_election.cc:288] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:57.207501 25450 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:57.207864 25450 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [term 1 LEADER]: Becoming Leader. State: Replica: 00e6db1ff1144a5daa73b1857ebdd91d, State: Running, Role: LEADER
I20260806 11:51:57.208390 25450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6db1ff1144a5daa73b1857ebdd91d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36571 } }
I20260806 11:51:57.208905 25435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:57.210551 25454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00e6db1ff1144a5daa73b1857ebdd91d. Latest consensus state: current_term: 1 leader_uuid: "00e6db1ff1144a5daa73b1857ebdd91d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6db1ff1144a5daa73b1857ebdd91d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36571 } } }
I20260806 11:51:57.210716 25454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:57.211905 25452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00e6db1ff1144a5daa73b1857ebdd91d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00e6db1ff1144a5daa73b1857ebdd91d" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 36571 } } }
I20260806 11:51:57.212165 25452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:57.212666 25439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:57.206646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38157 (local address 127.26.172.254:36571)
0806 11:51:57.206869 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:57.206874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:57.207132 (+ 258us) server_negotiation.cc:407] Connection header received
0806 11:51:57.207299 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:57.207303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:57.207375 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:57.207498 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:57.207997 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:57.208781 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:57.209991 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:51:57.210363 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:51:57.210447 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:51:57.211747 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:57.211753 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:57.211758 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:57.211776 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:57.211811 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:57.211831 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:57.211913 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:57.212417 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 11:51:57.212484 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 11:51:57.216116 25474 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:51:57.216228 25474 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:51:57.216321 25469 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:57.217061 25469 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:57.223763 25469 catalog_manager.cc:1347] Generated new cluster ID: a8188b51248f442e867fb5eb7433ce10
I20260806 11:51:57.223873 25469 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:57.237635 25469 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:57.239495 25469 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:57.250069 25469 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00e6db1ff1144a5daa73b1857ebdd91d: Generated new TSK 0
I20260806 11:51:57.251138 25469 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:57.264695 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 25332
2026-08-06T11:51:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1839 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:57 dist-test-slave-7z32 krb5kdc[25483](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:57 dist-test-slave-7z32 krb5kdc[25483](info): set up 2 sockets
Aug 06 11:51:57 dist-test-slave-7z32 krb5kdc[25483](info): commencing operation
krb5kdc: starting...
W20260806 11:51:58.547807 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.000s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:51:58 dist-test-slave-7z32 krb5kdc[25483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:51:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:51:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:51:58.720779 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46047
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:35663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:46047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:51:58.867550 25499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:51:58.868017 25499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:51:58.868104 25499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:51:58.872689 25499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:51:58.872836 25499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:51:58.872874 25499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:51:58.872916 25499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:51:58.872970 25499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:51:58.879664 25499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:35663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:46047
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:46047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:51:58.881435 25499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:51:58.883004 25499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:51:58.894657 25504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:51:58.894658 25508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:58.895006 25499 server_base.cc:1034] running on GCE node
W20260806 11:51:58.895211 25505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:51:58.896004 25499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:51:58.897464 25499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:51:58.898708 25499 hybrid_clock.cc:648] HybridClock initialized: now 1786017118898658 us; error 77 us; skew 500 ppm
Aug 06 11:51:58 dist-test-slave-7z32 krb5kdc[25483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017118, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:51:58.902319 25499 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:51:58.903584 25499 webserver.cc:460] Webserver started at http://127.26.172.254:42383/ using document root <none> and password file <none>
I20260806 11:51:58.904289 25499 fs_manager.cc:359] Metadata directory not provided
I20260806 11:51:58.904389 25499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:51:58.904637 25499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:51:58.907092 25499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "81bbf2d843d84832bd8773044660d2fa"
format_stamp: "Formatted at 2026-08-06 11:51:58 on dist-test-slave-7z32"
server_key: "26278f5fe93e40191fe13f60a3d95b5e"
server_key_iv: "7f3dcc9d0a56852f4c92ba68e260baea"
server_key_version: "encryptionkey@0"
I20260806 11:51:58.907775 25499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "81bbf2d843d84832bd8773044660d2fa"
format_stamp: "Formatted at 2026-08-06 11:51:58 on dist-test-slave-7z32"
server_key: "26278f5fe93e40191fe13f60a3d95b5e"
server_key_iv: "7f3dcc9d0a56852f4c92ba68e260baea"
server_key_version: "encryptionkey@0"
I20260806 11:51:58.912731 25499 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260806 11:51:58.916287 25517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:51:58.918175 25499 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 11:51:58.918481 25499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "81bbf2d843d84832bd8773044660d2fa"
format_stamp: "Formatted at 2026-08-06 11:51:58 on dist-test-slave-7z32"
server_key: "26278f5fe93e40191fe13f60a3d95b5e"
server_key_iv: "7f3dcc9d0a56852f4c92ba68e260baea"
server_key_version: "encryptionkey@0"
I20260806 11:51:58.918653 25499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:51:58.924319 25499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:51:58.928354 25499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:51:58.928627 25499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:51:58.937845 25499 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:46047
I20260806 11:51:58.937949 25591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:46047 every 8 connection(s)
I20260806 11:51:58.939111 25499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:51:58.942229 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 25499
I20260806 11:51:58.942355 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:51:58.942729 27315 external_mini_cluster.cc:1428] Setting key 0c0da575c3146a3335cb154a89f37174
I20260806 11:51:58.943315 25592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:51:58.949391 25597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:58.944592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39051 (local address 127.26.172.254:46047)
0806 11:51:58.945086 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:58.945104 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:58.945142 (+ 38us) server_negotiation.cc:407] Connection header received
0806 11:51:58.945913 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:58.945932 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:58.946256 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:58.946569 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:58.947857 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:58.947863 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:58.947877 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:58.947890 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:58.947956 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:58.947978 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:58.948122 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:58.948268 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 11:51:58.948466 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":169,"threads_started":1}
I20260806 11:51:58.952299 25592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa: Bootstrap starting.
I20260806 11:51:58.952857 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:51:58.955704 25592 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa: Neither blocks nor log segments found. Creating new log.
I20260806 11:51:58.956687 25592 log.cc:824] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa: Log is configured to *not* fsync() on all Append() calls
I20260806 11:51:58.957924 25597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:51:58.955657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40111 (local address 127.26.172.254:46047)
0806 11:51:58.955822 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 11:51:58.955830 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:51:58.956179 (+ 349us) server_negotiation.cc:407] Connection header received
0806 11:51:58.956416 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:51:58.956419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:51:58.956457 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:51:58.956558 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:51:58.957462 (+ 904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:51:58.957466 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:51:58.957469 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 11:51:58.957482 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:51:58.957514 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 11:51:58.957534 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:51:58.957640 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 11:51:58.957735 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 11:51:58.957781 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 11:51:58.959618 25592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa: No bootstrap required, opened a new log
I20260806 11:51:58.964248 25592 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81bbf2d843d84832bd8773044660d2fa" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46047 } }
I20260806 11:51:58.964615 25592 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 11:51:58.964689 25592 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81bbf2d843d84832bd8773044660d2fa, State: Initialized, Role: FOLLOWER
I20260806 11:51:58.965271 25592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81bbf2d843d84832bd8773044660d2fa" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46047 } }
I20260806 11:51:58.965472 25592 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 11:51:58.965574 25592 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 11:51:58.965716 25592 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:51:58.967092 25592 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81bbf2d843d84832bd8773044660d2fa" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46047 } }
I20260806 11:51:58.967499 25592 leader_election.cc:302] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81bbf2d843d84832bd8773044660d2fa; no voters:
I20260806 11:51:58.967886 25592 leader_election.cc:288] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 11:51:58.968106 25608 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:51:58.968578 25608 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [term 1 LEADER]: Becoming Leader. State: Replica: 81bbf2d843d84832bd8773044660d2fa, State: Running, Role: LEADER
I20260806 11:51:58.969014 25608 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81bbf2d843d84832bd8773044660d2fa" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46047 } }
I20260806 11:51:58.969676 25592 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:51:58.971103 25610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81bbf2d843d84832bd8773044660d2fa. Latest consensus state: current_term: 1 leader_uuid: "81bbf2d843d84832bd8773044660d2fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81bbf2d843d84832bd8773044660d2fa" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46047 } } }
I20260806 11:51:58.971275 25610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:58.971738 25609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81bbf2d843d84832bd8773044660d2fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81bbf2d843d84832bd8773044660d2fa" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 46047 } } }
I20260806 11:51:58.971895 25609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa [sys.catalog]: This master's current role is: LEADER
I20260806 11:51:58.971741 25622 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:51:58.975589 25622 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:51:58.983817 25622 catalog_manager.cc:1347] Generated new cluster ID: ca3eda3e21ed40e9a7d5cb1168da2a68
I20260806 11:51:58.983947 25622 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:51:58.993342 25622 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:51:58.993791 25622 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:51:59.001808 25622 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 81bbf2d843d84832bd8773044660d2fa: Generated new TSK 0
I20260806 11:51:59.002936 25622 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 11:51:59.013628 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 25499
2026-08-06T11:51:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1746 ms)
[----------] 18 tests from AuthTokenIssuingTest (32235 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:51:59 dist-test-slave-7z32 krb5kdc[25635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:51:59 dist-test-slave-7z32 krb5kdc[25635](info): set up 2 sockets
Aug 06 11:51:59 dist-test-slave-7z32 krb5kdc[25635](info): commencing operation
krb5kdc: starting...
W20260806 11:52:00.300487 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:52:00 dist-test-slave-7z32 krb5kdc[25635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:52:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:52:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:52:00.471513 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:32991
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:32991,127.26.172.253:37611,127.26.172.252:43103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:52:00.622761 25653 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 11:52:00.623241 25653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:52:00.623271 25653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:52:00.623391 25653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:52:00.628199 25653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:52:00.628306 25653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:52:00.628327 25653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:52:00.628346 25653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:52:00.628363 25653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:52:00.634910 25653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:32991,127.26.172.253:37611,127.26.172.252:43103
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:32991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:52:00.636643 25653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:52:00.638073 25653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:52:00.649603 25664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:00.649562 25661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:52:00.650025 25653 server_base.cc:1034] running on GCE node
W20260806 11:52:00.649562 25666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:52:00.651026 25653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:52:00.652343 25653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:52:00.653529 25653 hybrid_clock.cc:648] HybridClock initialized: now 1786017120653512 us; error 45 us; skew 500 ppm
Aug 06 11:52:00 dist-test-slave-7z32 krb5kdc[25635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:52:00.657141 25653 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:52:00.658231 25653 webserver.cc:460] Webserver started at http://127.26.172.254:39693/ using document root <none> and password file <none>
I20260806 11:52:00.659026 25653 fs_manager.cc:359] Metadata directory not provided
I20260806 11:52:00.659132 25653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:52:00.659394 25653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:52:00.661677 25653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "cadfc6bce7a9407ebb7b642d99bff63e"
format_stamp: "Formatted at 2026-08-06 11:52:00 on dist-test-slave-7z32"
server_key: "092a5a793aab717e4c32f072c7f4200b"
server_key_iv: "44c6c00ca71172d769c4443e1f3408ba"
server_key_version: "encryptionkey@0"
I20260806 11:52:00.662313 25653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "cadfc6bce7a9407ebb7b642d99bff63e"
format_stamp: "Formatted at 2026-08-06 11:52:00 on dist-test-slave-7z32"
server_key: "092a5a793aab717e4c32f072c7f4200b"
server_key_iv: "44c6c00ca71172d769c4443e1f3408ba"
server_key_version: "encryptionkey@0"
I20260806 11:52:00.667100 25653 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 11:52:00.670444 25674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:52:00.672254 25653 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:52:00.672461 25653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "cadfc6bce7a9407ebb7b642d99bff63e"
format_stamp: "Formatted at 2026-08-06 11:52:00 on dist-test-slave-7z32"
server_key: "092a5a793aab717e4c32f072c7f4200b"
server_key_iv: "44c6c00ca71172d769c4443e1f3408ba"
server_key_version: "encryptionkey@0"
I20260806 11:52:00.672602 25653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:52:00.698457 25653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:52:00.702996 25653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:52:00.703315 25653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:52:00.713955 25653 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:32991
I20260806 11:52:00.714332 25748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:32991 every 8 connection(s)
I20260806 11:52:00.715529 25653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:52:00.719977 25749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:52:00.723706 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 25653
I20260806 11:52:00.723933 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:52:00.724341 27315 external_mini_cluster.cc:1428] Setting key 2300705310815b546618da58edde0a21
I20260806 11:52:00.724870 25749 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.172.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.253@KRBTEST.COM" created.
Aug 06 11:52:00 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:52:00.749797 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:00.727650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:32991 (local address 127.0.0.1:40270)
0806 11:52:00.728271 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:00.728343 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:00.729452 (+ 1109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:00.730620 (+ 1168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:00.730627 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:00.731146 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:00.731633 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:00.731653 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:00.734068 (+ 2415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:00.734072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:00.735200 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:00.735216 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:00.736519 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:00.736522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:00.736705 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:00.737581 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:00.737638 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:00.742743 (+ 5105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:00.745748 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:00.745768 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:00.745784 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:00.746198 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:00.746779 (+ 581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:00.746784 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:00.746786 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:00.746973 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:00.747747 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:00.747755 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:00.747927 (+ 172us) client_negotiation.cc:769] Sending connection context
0806 11:52:00.748126 (+ 199us) client_negotiation.cc:240] Negotiation successful
0806 11:52:00.748627 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":271,"thread_start_us":195,"threads_started":1}
I20260806 11:52:00.749802 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:00.728689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40270 (local address 127.26.172.254:32991)
0806 11:52:00.729384 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:00.729405 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:00.729511 (+ 106us) server_negotiation.cc:407] Connection header received
0806 11:52:00.729867 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:00.729879 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:00.730276 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:00.730594 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:00.731865 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:00.733798 (+ 1933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:00.735417 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:00.736270 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:00.736577 (+ 307us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:00.743045 (+ 6468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:00.743052 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:00.743069 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:00.743096 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:00.745527 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:00.746426 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:00.746437 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:00.746441 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:00.746643 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:00.747098 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:00.747101 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:00.747103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:00.747602 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:00.747771 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:00.748224 (+ 453us) server_negotiation.cc:299] Negotiation successful
0806 11:52:00.748563 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":120,"server-negotiator.queue_time_us":457,"thread_start_us":126,"threads_started":1}
I20260806 11:52:00.752610 25749 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } has no permanent_uuid. Determining permanent_uuid...
I20260806 11:52:00.753767 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:00.753409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:34934)
0806 11:52:00.753589 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:00.753687 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260806 11:52:00.754173 25677 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
I20260806 11:52:00.755466 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:00.755003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:34948)
0806 11:52:00.755235 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:00.755308 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260806 11:52:00.755800 25749 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:37611: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab.
Entry for principal kudu/127.26.172.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab.
I20260806 11:52:00.768689 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.253:37611
--webserver_interface=127.26.172.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab
--principal=kudu/127.26.172.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:32991,127.26.172.253:37611,127.26.172.252:43103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:52:00.805303 25749 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } attempt: 1
I20260806 11:52:00.806802 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:00.806258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:34950)
0806 11:52:00.806521 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:00.806678 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260806 11:52:00.807992 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:00.807708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:34958)
0806 11:52:00.807843 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:00.807913 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 11:52:00.808171 25749 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:37611: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
I20260806 11:52:00.876358 25749 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } attempt: 2
I20260806 11:52:00.877584 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:00.877157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:34960)
0806 11:52:00.877416 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:00.877485 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 11:52:00.878394 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:00.878134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:34976)
0806 11:52:00.878268 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:00.878326 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 11:52:00.878561 25749 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:37611: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
W20260806 11:52:00.918018 25757 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 11:52:00.918619 25757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:52:00.918681 25757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:52:00.918792 25757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:52:00.928944 25757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:52:00.929085 25757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:52:00.929133 25757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:52:00.929172 25757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:52:00.929208 25757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:52:00.942276 25757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:32991,127.26.172.253:37611,127.26.172.252:43103
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab
--principal=kudu/127.26.172.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.253:37611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.172.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:52:00.944072 25757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:52:00.945685 25757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:52:00.958338 25766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:00.958405 25765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:00.958370 25769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:52:00.959589 25757 server_base.cc:1034] running on GCE node
I20260806 11:52:00.960517 25757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:52:00.962132 25757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:52:00.963579 25757 hybrid_clock.cc:648] HybridClock initialized: now 1786017120963535 us; error 68 us; skew 500 ppm
Aug 06 11:52:00 dist-test-slave-7z32 krb5kdc[25635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:52:00.968093 25757 init.cc:377] Logged in from keytab as kudu/127.26.172.253@KRBTEST.COM (short username kudu)
I20260806 11:52:00.969782 25757 webserver.cc:460] Webserver started at http://127.26.172.253:46513/ using document root <none> and password file <none>
I20260806 11:52:00.970371 25749 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } attempt: 3
I20260806 11:52:00.970737 25757 fs_manager.cc:359] Metadata directory not provided
I20260806 11:52:00.970913 25757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:52:00.971239 25757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:52:00.972515 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:00.971997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:34984)
0806 11:52:00.972287 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:00.972390 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260806 11:52:00.973882 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:00.973408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:35000)
0806 11:52:00.973623 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:00.973727 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260806 11:52:00.974143 25749 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:37611: Network error: Client connection negotiation failed: client connection to 127.26.172.253:37611: connect: Connection refused (error 111)
I20260806 11:52:00.974691 25757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/data/instance:
uuid: "2aa8b1e432dd4931a53473da33a38ebf"
format_stamp: "Formatted at 2026-08-06 11:52:00 on dist-test-slave-7z32"
server_key: "df2fec2a4487ed384423e31b551bc81c"
server_key_iv: "eaff6582392b8ce48caf2fc81b8577af"
server_key_version: "encryptionkey@0"
I20260806 11:52:00.975508 25757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/wal/instance:
uuid: "2aa8b1e432dd4931a53473da33a38ebf"
format_stamp: "Formatted at 2026-08-06 11:52:00 on dist-test-slave-7z32"
server_key: "df2fec2a4487ed384423e31b551bc81c"
server_key_iv: "eaff6582392b8ce48caf2fc81b8577af"
server_key_version: "encryptionkey@0"
I20260806 11:52:00.982384 25757 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.004s
I20260806 11:52:00.986732 25781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:52:00.988740 25757 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260806 11:52:00.988976 25757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/wal
uuid: "2aa8b1e432dd4931a53473da33a38ebf"
format_stamp: "Formatted at 2026-08-06 11:52:00 on dist-test-slave-7z32"
server_key: "df2fec2a4487ed384423e31b551bc81c"
server_key_iv: "eaff6582392b8ce48caf2fc81b8577af"
server_key_version: "encryptionkey@0"
I20260806 11:52:00.989167 25757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:52:01.008190 25757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:52:01.013161 25757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:52:01.013487 25757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:52:01.025283 25757 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.253:37611
I20260806 11:52:01.025636 25853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.253:37611 every 8 connection(s)
I20260806 11:52:01.026755 25757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
I20260806 11:52:01.030548 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 25757
I20260806 11:52:01.030754 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-1/wal/instance
I20260806 11:52:01.030901 25854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:52:01.031278 27315 external_mini_cluster.cc:1428] Setting key f505c6006eadc7126e09c9317f31e236
I20260806 11:52:01.037817 25854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.172.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.252@KRBTEST.COM" created.
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:52:01.061983 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.041749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40280 (local address 127.26.172.254:32991)
0806 11:52:01.041973 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.041980 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.043604 (+ 1624us) server_negotiation.cc:407] Connection header received
0806 11:52:01.045546 (+ 1942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.045555 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.045654 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.045820 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.047664 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.048759 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.051132 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.051710 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.051882 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.057017 (+ 5135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.057024 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.057029 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.057076 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.059130 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.059906 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.059915 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.059917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.060007 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.060455 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.060459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.060461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.060738 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.060863 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.061571 (+ 708us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.061753 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 11:52:01.063271 25857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.042386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:32991 (local address 127.0.0.1:40280)
0806 11:52:01.043335 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.043429 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:01.045198 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:01.046099 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:01.046109 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:01.046539 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:01.047451 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.047472 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.049020 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.049026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.050918 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.050939 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.052222 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.052231 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.052638 (+ 407us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.053746 (+ 1108us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:01.053782 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:01.056656 (+ 2874us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:01.059329 (+ 2673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.059340 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.059373 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.059768 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.060117 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.060121 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.060123 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.060332 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.060871 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:01.060882 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:01.061272 (+ 390us) client_negotiation.cc:769] Sending connection context
0806 11:52:01.061518 (+ 246us) client_negotiation.cc:240] Negotiation successful
0806 11:52:01.062043 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":271,"threads_started":1}
I20260806 11:52:01.065377 25854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab.
Entry for principal kudu/127.26.172.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab.
I20260806 11:52:01.076997 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.252:43103
--webserver_interface=127.26.172.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab
--principal=kudu/127.26.172.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:32991,127.26.172.253:37611,127.26.172.252:43103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:52:01.078967 25857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.066158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:35014)
0806 11:52:01.066723 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.066741 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:01.066939 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:01.067444 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:01.067446 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:01.067709 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:01.067807 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.067812 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.069069 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.069072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.069703 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.069712 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.070508 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.070512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.070636 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.071282 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:01.071295 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:01.073346 (+ 2051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:01.076631 (+ 3285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.076634 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.076636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.076935 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.077423 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.077426 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.077428 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.077531 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.078184 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:01.078187 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:01.078309 (+ 122us) client_negotiation.cc:769] Sending connection context
0806 11:52:01.078446 (+ 137us) client_negotiation.cc:240] Negotiation successful
0806 11:52:01.078648 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 11:52:01.078984 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.066351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35014 (local address 127.26.172.253:37611)
0806 11:52:01.066739 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.066756 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.066885 (+ 129us) server_negotiation.cc:407] Connection header received
0806 11:52:01.067038 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.067045 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.067314 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.067477 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.067926 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.068935 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.069896 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.070350 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.070482 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.073576 (+ 3094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.073596 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.073617 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.073642 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.076447 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.077067 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.077075 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.077077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.077235 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.077653 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.077656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.077658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.078032 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.078250 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.078571 (+ 321us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.078742 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":173,"threads_started":1}
I20260806 11:52:01.081873 25854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } has no permanent_uuid. Determining permanent_uuid...
I20260806 11:52:01.082998 25857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.082570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39368)
0806 11:52:01.082740 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.082892 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260806 11:52:01.083231 25783 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
I20260806 11:52:01.084697 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.084104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39378)
0806 11:52:01.084443 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.084509 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":131,"threads_started":1}
W20260806 11:52:01.084864 25854 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:43103: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
I20260806 11:52:01.117353 25749 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } attempt: 4
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
I20260806 11:52:01.129391 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.118226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:35028)
0806 11:52:01.118589 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.118604 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:01.118758 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:01.119100 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:01.119103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:01.119384 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:01.119523 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.119529 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.120836 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.120842 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.121467 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.121476 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.122029 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.122033 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.122158 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.122785 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:01.122798 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:01.124736 (+ 1938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:01.127478 (+ 2742us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.127482 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.127485 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.127783 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.128139 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.128142 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.128145 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.128237 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.128763 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:01.128766 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:01.128885 (+ 119us) client_negotiation.cc:769] Sending connection context
0806 11:52:01.128993 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 11:52:01.129186 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252}
I20260806 11:52:01.130019 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.118332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35028 (local address 127.26.172.253:37611)
0806 11:52:01.118521 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.118528 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.118736 (+ 208us) server_negotiation.cc:407] Connection header received
0806 11:52:01.118929 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.118932 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.118986 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.119081 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.119667 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.120703 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.121604 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.121881 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.122025 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.125064 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.125070 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.125073 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.125116 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.127282 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.127914 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.127918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.127920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.128029 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.128342 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.128346 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.128347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.128615 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.128713 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.129683 (+ 970us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.129839 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 11:52:01.131280 25749 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } has no permanent_uuid. Determining permanent_uuid...
I20260806 11:52:01.132367 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.131979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39388)
0806 11:52:01.132194 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.132283 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260806 11:52:01.133327 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.133069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39396)
0806 11:52:01.133203 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.133265 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 11:52:01.133597 25749 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:43103: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
I20260806 11:52:01.134460 25854 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } attempt: 1
I20260806 11:52:01.135641 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.135268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39412)
0806 11:52:01.135501 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.135555 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
I20260806 11:52:01.136484 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.136239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39428)
0806 11:52:01.136373 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.136420 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260806 11:52:01.136684 25854 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:43103: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
I20260806 11:52:01.194166 25749 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } attempt: 1
I20260806 11:52:01.195447 25752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.194974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39430)
0806 11:52:01.195249 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.195324 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161}
I20260806 11:52:01.198333 25867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.196094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39432)
0806 11:52:01.198026 (+ 1932us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.198159 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1749,"thread_start_us":1538,"threads_started":1}
W20260806 11:52:01.198542 25749 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:43103: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
I20260806 11:52:01.204972 25854 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } attempt: 2
I20260806 11:52:01.206490 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.205853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39442)
0806 11:52:01.206264 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.206363 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238}
I20260806 11:52:01.207918 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.207567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39458)
0806 11:52:01.207747 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.207818 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260806 11:52:01.208176 25854 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:43103: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
W20260806 11:52:01.236056 25862 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 11:52:01.236461 25862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:52:01.236533 25862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:52:01.236617 25862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:52:01.240891 25862 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:52:01.241004 25862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:52:01.241040 25862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:52:01.241078 25862 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:52:01.241120 25862 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:52:01.246970 25862 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:32991,127.26.172.253:37611,127.26.172.252:43103
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab
--principal=kudu/127.26.172.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.252:43103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.172.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:52:01.248272 25862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:52:01.249408 25862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:52:01.259696 25875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:01.259886 25877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:01.259696 25874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:52:01.260110 25862 server_base.cc:1034] running on GCE node
I20260806 11:52:01.261027 25862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:52:01.262655 25862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:52:01.263918 25862 hybrid_clock.cc:648] HybridClock initialized: now 1786017121263898 us; error 42 us; skew 500 ppm
I20260806 11:52:01.265787 25749 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } attempt: 2
I20260806 11:52:01.267037 25867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.266564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39460)
0806 11:52:01.266787 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.266940 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017121, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:52:01.268036 25867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.267739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39470)
0806 11:52:01.267894 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.267975 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260806 11:52:01.268220 25749 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:43103: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
I20260806 11:52:01.268596 25862 init.cc:377] Logged in from keytab as kudu/127.26.172.252@KRBTEST.COM (short username kudu)
I20260806 11:52:01.270243 25862 webserver.cc:460] Webserver started at http://127.26.172.252:36049/ using document root <none> and password file <none>
I20260806 11:52:01.271131 25862 fs_manager.cc:359] Metadata directory not provided
I20260806 11:52:01.271242 25862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:52:01.271546 25862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:52:01.274914 25862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/data/instance:
uuid: "36a5b5f4839e437f972c409a406028ee"
format_stamp: "Formatted at 2026-08-06 11:52:01 on dist-test-slave-7z32"
server_key: "843de59708d386d099d4c436ba0fccd8"
server_key_iv: "6edb4b830ee76e8f7164b9fec20a86c8"
server_key_version: "encryptionkey@0"
I20260806 11:52:01.275772 25862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/wal/instance:
uuid: "36a5b5f4839e437f972c409a406028ee"
format_stamp: "Formatted at 2026-08-06 11:52:01 on dist-test-slave-7z32"
server_key: "843de59708d386d099d4c436ba0fccd8"
server_key_iv: "6edb4b830ee76e8f7164b9fec20a86c8"
server_key_version: "encryptionkey@0"
I20260806 11:52:01.282186 25862 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 11:52:01.286403 25884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:52:01.288466 25862 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:52:01.288717 25862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/wal
uuid: "36a5b5f4839e437f972c409a406028ee"
format_stamp: "Formatted at 2026-08-06 11:52:01 on dist-test-slave-7z32"
server_key: "843de59708d386d099d4c436ba0fccd8"
server_key_iv: "6edb4b830ee76e8f7164b9fec20a86c8"
server_key_version: "encryptionkey@0"
I20260806 11:52:01.288923 25862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:52:01.299384 25854 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } attempt: 3
I20260806 11:52:01.300637 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.300153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39474)
0806 11:52:01.300413 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.300514 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 11:52:01.302026 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.301599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39490)
0806 11:52:01.301809 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.301937 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
W20260806 11:52:01.302317 25854 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:43103: Network error: Client connection negotiation failed: client connection to 127.26.172.252:43103: connect: Connection refused (error 111)
I20260806 11:52:01.304025 25862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:52:01.307952 25862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:52:01.308214 25862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:52:01.316947 25862 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.252:43103
I20260806 11:52:01.317269 25958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.252:43103 every 8 connection(s)
I20260806 11:52:01.318198 25862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
I20260806 11:52:01.321461 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 25862
I20260806 11:52:01.321678 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786016786541679-27315-0/minicluster-data/master-2/wal/instance
I20260806 11:52:01.322150 27315 external_mini_cluster.cc:1428] Setting key ae17cfbd22f9acfab3feee1c9025e6f2
I20260806 11:52:01.323096 25959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:52:01.329283 25959 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017121, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:52:01.342473 25963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.324500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39502 (local address 127.26.172.252:43103)
0806 11:52:01.325185 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.325206 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.325267 (+ 61us) server_negotiation.cc:407] Connection header received
0806 11:52:01.326084 (+ 817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.326106 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.326525 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.327005 (+ 480us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.327955 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.329056 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.330052 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.330593 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.330790 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.335102 (+ 4312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.335276 (+ 174us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.335312 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.335368 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.337856 (+ 2488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.338693 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.338700 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.338706 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.338961 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.339392 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.339396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.339398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.340175 (+ 777us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.340471 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.340957 (+ 486us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.341387 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":210,"threads_started":1}
I20260806 11:52:01.345288 25964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.331797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:32991 (local address 127.0.0.1:40288)
0806 11:52:01.332544 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.332805 (+ 261us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:01.333046 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:01.333451 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:01.333457 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:01.333924 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:01.334209 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.334219 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.335362 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.335366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.336628 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.336642 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.337406 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.337412 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.337589 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.338326 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:01.338345 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:01.340652 (+ 2307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:01.342889 (+ 2237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.342897 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.342903 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.343224 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.343734 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.343738 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.343740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.343849 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.344537 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:01.344543 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:01.344686 (+ 143us) client_negotiation.cc:769] Sending connection context
0806 11:52:01.344842 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 11:52:01.345058 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":217,"threads_started":1}
I20260806 11:52:01.345393 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.331950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40288 (local address 127.26.172.254:32991)
0806 11:52:01.332154 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.332160 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.332966 (+ 806us) server_negotiation.cc:407] Connection header received
0806 11:52:01.333174 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.333177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.333231 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.333313 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.334381 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.335116 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.336886 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.337210 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.337370 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.340841 (+ 3471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.340844 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.340847 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.340875 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.342692 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.343406 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.343412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.343413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.343579 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.344019 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.344024 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.344026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.344361 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.344499 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.344957 (+ 458us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.345145 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 11:52:01.347222 25959 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017121, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
I20260806 11:52:01.357930 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.346352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40302 (local address 127.26.172.254:32991)
0806 11:52:01.346479 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.346486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.346541 (+ 55us) server_negotiation.cc:407] Connection header received
0806 11:52:01.346764 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.346767 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.346904 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.347009 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.347841 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.348554 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.349603 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.349851 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.349973 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.353322 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.353326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.353328 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.353363 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.355456 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.356151 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.356155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.356157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.356256 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.356704 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.356707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.356708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.356961 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.357270 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.357549 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.357720 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 11:52:01.358457 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.348088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35042 (local address 127.26.172.253:37611)
0806 11:52:01.348239 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.348243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.348472 (+ 229us) server_negotiation.cc:407] Connection header received
0806 11:52:01.348549 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.348552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.348630 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.348724 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.349265 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.349843 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.350736 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.351099 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.351231 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.354214 (+ 2983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.354220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.354222 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.354257 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.356281 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.356906 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.356910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.356912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.357014 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.357355 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.357360 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.357362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.357623 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.357746 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.358105 (+ 359us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.358244 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 11:52:01.358457 25964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.347934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:37611 (local address 127.0.0.1:35042)
0806 11:52:01.348351 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.348367 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:01.348465 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:01.348775 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:01.348778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:01.348980 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:01.349108 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.349115 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.350004 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.350008 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.350586 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.350597 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.351241 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.351245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.351389 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.351916 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:01.351938 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:01.353989 (+ 2051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:01.356485 (+ 2496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.356490 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.356492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.356784 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.357132 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.357136 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.357138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.357237 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.357735 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:01.357738 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:01.357868 (+ 130us) client_negotiation.cc:769] Sending connection context
0806 11:52:01.358035 (+ 167us) client_negotiation.cc:240] Negotiation successful
0806 11:52:01.358230 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327}
I20260806 11:52:01.359982 25959 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017121, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
I20260806 11:52:01.368404 25749 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } attempt: 3
I20260806 11:52:01.373292 25964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.360780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39504)
0806 11:52:01.360910 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.360929 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:01.361024 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:01.361336 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:01.361341 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:01.361620 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:01.361761 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.361770 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.362626 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.362633 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.363351 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.363361 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.363918 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.363922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.364002 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.364710 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:01.364731 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:01.366680 (+ 1949us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:01.369517 (+ 2837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.369523 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.369526 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.369876 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.370300 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.370304 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.370307 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.370433 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.372375 (+ 1942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:01.372377 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:01.372501 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 11:52:01.372753 (+ 252us) client_negotiation.cc:240] Negotiation successful
0806 11:52:01.373042 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":25}
I20260806 11:52:01.373292 25963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.360933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39504 (local address 127.26.172.252:43103)
0806 11:52:01.361089 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.361093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.361107 (+ 14us) server_negotiation.cc:407] Connection header received
0806 11:52:01.361141 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.361143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.361191 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.361262 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.361902 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.362497 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.363494 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.363773 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.363909 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.366961 (+ 3052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.366967 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.366971 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.367014 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.369351 (+ 2337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.370016 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.370022 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.370027 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.370141 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.371979 (+ 1838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.371983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.371985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.372241 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.372368 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.372813 (+ 445us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.373144 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":150,"server-negotiator.queue_time_us":55}
I20260806 11:52:01.375000 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.359988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35052 (local address 127.26.172.253:37611)
0806 11:52:01.360134 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.360138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.360291 (+ 153us) server_negotiation.cc:407] Connection header received
0806 11:52:01.360408 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.360410 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.360506 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.360711 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.361784 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.362352 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.363378 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.363621 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.363747 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.368115 (+ 4368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.368122 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.368128 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.368173 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.371233 (+ 3060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.372472 (+ 1239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.372476 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.372479 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.372573 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.373030 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.373034 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.373035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.373296 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.373569 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.374611 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.374745 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
I20260806 11:52:01.378269 25959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee: Bootstrap starting.
I20260806 11:52:01.381033 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:52:01.381945 25959 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee: Neither blocks nor log segments found. Creating new log.
I20260806 11:52:01.382722 25965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.369222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39520 (local address 127.26.172.252:43103)
0806 11:52:01.369786 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.369795 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.369808 (+ 13us) server_negotiation.cc:407] Connection header received
0806 11:52:01.369844 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.369846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.369887 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.370083 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.371070 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.372638 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.373985 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.374357 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.374476 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.378210 (+ 3734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.378214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.378216 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.378244 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.380579 (+ 2335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.381139 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.381143 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.381146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.381248 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.381601 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.381605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.381607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.381867 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.382000 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.382334 (+ 334us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.382480 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":218,"threads_started":1}
I20260806 11:52:01.382714 25867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.369179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39520)
0806 11:52:01.369399 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.369436 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:01.369563 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:01.370146 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:01.370149 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:01.370589 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:01.370814 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.370867 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.372810 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.372818 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.373800 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.373815 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.374551 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.374558 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.374752 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.375915 (+ 1163us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:01.375929 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:01.377771 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:01.380728 (+ 2957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.380733 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.380736 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.381001 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.381367 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.381371 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.381373 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.381479 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.381986 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:01.381990 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:01.382127 (+ 137us) client_negotiation.cc:769] Sending connection context
0806 11:52:01.382258 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 11:52:01.382480 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 11:52:01.383080 25959 log.cc:824] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee: Log is configured to *not* fsync() on all Append() calls
I20260806 11:52:01.383370 25711 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "cadfc6bce7a9407ebb7b642d99bff63e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40302
I20260806 11:52:01.386629 25959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee: No bootstrap required, opened a new log
I20260806 11:52:01.388366 25749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e: Bootstrap starting.
I20260806 11:52:01.391661 25749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e: Neither blocks nor log segments found. Creating new log.
I20260806 11:52:01.391786 25959 raft_consensus.cc:348] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } }
I20260806 11:52:01.392167 25959 raft_consensus.cc:729] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36a5b5f4839e437f972c409a406028ee, State: Initialized, Role: FOLLOWER
I20260806 11:52:01.392584 25959 consensus_queue.cc:260] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } }
I20260806 11:52:01.392828 25749 log.cc:824] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e: Log is configured to *not* fsync() on all Append() calls
I20260806 11:52:01.393352 25968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } } }
I20260806 11:52:01.393611 25968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:01.394519 25959 sys_catalog.cc:564] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:52:01.396445 25749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e: No bootstrap required, opened a new log
I20260806 11:52:01.401419 25749 raft_consensus.cc:348] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } }
I20260806 11:52:01.401793 25749 raft_consensus.cc:729] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cadfc6bce7a9407ebb7b642d99bff63e, State: Initialized, Role: FOLLOWER
I20260806 11:52:01.402245 25749 consensus_queue.cc:260] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } }
W20260806 11:52:01.402433 25988 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:52:01.402540 25988 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:52:01.404220 25749 sys_catalog.cc:564] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:52:01.400220 25862 master_runner.cc:186] Error getting master registration for 127.26.172.254:32991: OK, instance_id { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" instance_seqno: 1786017120710901 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 11:52:01.404378 25711 raft_consensus.cc:482] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 11:52:01.404484 25862 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 11:52:01.404584 25711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:52:01.406252 25711 raft_consensus.cc:504] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } }
I20260806 11:52:01.409756 25922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "36a5b5f4839e437f972c409a406028ee"
I20260806 11:52:01.410118 25922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:52:01.411043 25711 leader_election.cc:288] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [CANDIDATE]: Term 1 election: Requested vote from peers 2aa8b1e432dd4931a53473da33a38ebf (127.26.172.253:37611), 36a5b5f4839e437f972c409a406028ee (127.26.172.252:43103)
I20260806 11:52:01.411947 25922 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cadfc6bce7a9407ebb7b642d99bff63e in term 1.
I20260806 11:52:01.412473 25677 leader_election.cc:302] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36a5b5f4839e437f972c409a406028ee, cadfc6bce7a9407ebb7b642d99bff63e; no voters:
I20260806 11:52:01.413233 26013 sys_catalog.cc:455] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } } }
I20260806 11:52:01.413394 26013 sys_catalog.cc:458] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:01.413503 26013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:52:01.413579 26013 raft_consensus.cc:686] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [term 1 LEADER]: Becoming Leader. State: Replica: cadfc6bce7a9407ebb7b642d99bff63e, State: Running, Role: LEADER
I20260806 11:52:01.413983 26013 consensus_queue.cc:237] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } }
I20260806 11:52:01.418511 26013 sys_catalog.cc:455] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [sys.catalog]: SysCatalogTable state changed. Reason: New leader cadfc6bce7a9407ebb7b642d99bff63e. Latest consensus state: current_term: 1 leader_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } } }
I20260806 11:52:01.418699 26013 sys_catalog.cc:458] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [sys.catalog]: This master's current role is: LEADER
I20260806 11:52:01.415295 25653 master_runner.cc:186] Error getting master registration for 127.26.172.253:37611: OK, instance_id { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" instance_seqno: 1786017121022251 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 11:52:01.419620 25653 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 11:52:01.420150 26020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:52:01.425325 26020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:52:01.433236 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.414782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35068 (local address 127.26.172.253:37611)
0806 11:52:01.414972 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.414977 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.417085 (+ 2108us) server_negotiation.cc:407] Connection header received
0806 11:52:01.417446 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.417450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.417516 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.417577 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.420230 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.421051 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.423361 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.423719 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.423803 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.428159 (+ 4356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.428164 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.428169 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.428206 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.430056 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.431218 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.431224 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.431230 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.431326 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.431847 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.431853 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.431858 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.432139 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.432298 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.432882 (+ 584us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.433014 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 11:52:01.433792 25965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.416314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39536 (local address 127.26.172.252:43103)
0806 11:52:01.416469 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.416474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.421050 (+ 4576us) server_negotiation.cc:407] Connection header received
0806 11:52:01.421281 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.421284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.421350 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.421424 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.422550 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.423411 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.424594 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.425071 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.425163 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.429855 (+ 4692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.429862 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.429865 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.429902 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.431822 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.432334 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.432337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.432339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.432431 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.432747 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.432752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.432756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.432999 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.433117 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.433489 (+ 372us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.433632 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 11:52:01.440269 25922 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [term 1 FOLLOWER]: Refusing update from remote peer cadfc6bce7a9407ebb7b642d99bff63e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:52:01.441094 25993 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [LEADER]: Connected to new peer: Peer: permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:52:01.445513 25854 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } attempt: 4
I20260806 11:52:01.446617 25968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader cadfc6bce7a9407ebb7b642d99bff63e. Latest consensus state: current_term: 1 leader_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } } }
I20260806 11:52:01.446843 25968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [sys.catalog]: This master's current role is: FOLLOWER
Aug 06 11:52:01 dist-test-slave-7z32 krb5kdc[25635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017120, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
W20260806 11:52:01.455854 25682 tablet.cc:2369] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:52:01.458680 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.415312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40318 (local address 127.26.172.254:32991)
0806 11:52:01.415552 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.415560 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.433879 (+ 18319us) server_negotiation.cc:407] Connection header received
0806 11:52:01.434180 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.434185 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.434261 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.434335 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.435627 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.436462 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.437749 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.438113 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.438251 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.451625 (+ 13374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.451631 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.451634 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.451682 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.453854 (+ 2172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.456163 (+ 2309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.456168 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.456170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.456285 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.456778 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.456784 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.456786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.457135 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.457348 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.458320 (+ 972us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.458484 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 11:52:01.459360 25993 sys_catalog.cc:455] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } } }
I20260806 11:52:01.459529 25993 sys_catalog.cc:458] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [sys.catalog]: This master's current role is: LEADER
I20260806 11:52:01.461378 25968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } } }
I20260806 11:52:01.461550 25968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:01.462054 26023 mvcc.cc:205] Tried to move back new op lower bound from 7315526129409187840 to 7315526129324797952. Current Snapshot: MvccSnapshot[applied={T|T < 7315526129409187840}]
I20260806 11:52:01.465852 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.447238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:43103 (local address 127.0.0.1:39540)
0806 11:52:01.447812 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:01.447834 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:01.447999 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:01.448520 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:01.448525 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:01.448846 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:01.449038 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.449047 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.450121 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.450124 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.451022 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:01.451037 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.451847 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.451853 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:01.451978 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.452568 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:01.452590 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:01.459575 (+ 6985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:01.463836 (+ 4261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.463841 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.463845 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.464147 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.464519 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:01.464524 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:01.464529 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:01.464631 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:01.465190 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:01.465195 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:01.465315 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 11:52:01.465428 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 11:52:01.465623 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455}
I20260806 11:52:01.466711 25965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:01.447259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39540 (local address 127.26.172.252:43103)
0806 11:52:01.447396 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.447401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.447940 (+ 539us) server_negotiation.cc:407] Connection header received
0806 11:52:01.448129 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.448132 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.448191 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.448301 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.449191 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.449984 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.451177 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:01.451553 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:01.451677 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:01.459814 (+ 8137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:01.459822 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:01.459829 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:01.459870 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:01.463691 (+ 3821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.464282 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.464289 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.464292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.464392 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:01.464748 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:01.464752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:01.464754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:01.465031 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:01.465138 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:01.466374 (+ 1236us) server_negotiation.cc:299] Negotiation successful
0806 11:52:01.466548 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 11:52:01.472604 25854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf: Bootstrap starting.
I20260806 11:52:01.476214 25854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf: Neither blocks nor log segments found. Creating new log.
I20260806 11:52:01.476647 26020 catalog_manager.cc:1347] Generated new cluster ID: e865346690554851bc8c733b5ecc9717
I20260806 11:52:01.476761 26020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:52:01.478772 25854 log.cc:824] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf: Log is configured to *not* fsync() on all Append() calls
I20260806 11:52:01.483143 25854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf: No bootstrap required, opened a new log
I20260806 11:52:01.489429 25854 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } }
I20260806 11:52:01.489782 25854 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aa8b1e432dd4931a53473da33a38ebf, State: Initialized, Role: FOLLOWER
I20260806 11:52:01.490159 25854 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } }
I20260806 11:52:01.491729 25854 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:52:01.491811 25815 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2aa8b1e432dd4931a53473da33a38ebf"
I20260806 11:52:01.492057 25815 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:52:01.493834 25815 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cadfc6bce7a9407ebb7b642d99bff63e in term 1.
I20260806 11:52:01.495798 25814 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [term 1 FOLLOWER]: Refusing update from remote peer cadfc6bce7a9407ebb7b642d99bff63e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:52:01.496891 25993 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 11:52:01.501416 26046 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:52:01.501544 26046 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:52:01.506933 26057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [sys.catalog]: SysCatalogTable state changed. Reason: New leader cadfc6bce7a9407ebb7b642d99bff63e. Latest consensus state: current_term: 1 leader_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } } }
I20260806 11:52:01.507143 26057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:01.507279 26057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } } }
I20260806 11:52:01.507400 26057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:01.507793 26048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } } }
I20260806 11:52:01.507983 26048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf [sys.catalog]: This master's current role is: FOLLOWER
W20260806 11:52:01.516029 25788 tablet.cc:2369] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:52:01.520954 26050 mvcc.cc:205] Tried to move back new op lower bound from 7315526129409187840 to 7315526129324797952. Current Snapshot: MvccSnapshot[applied={T|T < 7315526129409187840}]
I20260806 11:52:01.537945 25993 sys_catalog.cc:455] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cadfc6bce7a9407ebb7b642d99bff63e" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 32991 } } peers { permanent_uuid: "2aa8b1e432dd4931a53473da33a38ebf" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 37611 } } peers { permanent_uuid: "36a5b5f4839e437f972c409a406028ee" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 43103 } } }
I20260806 11:52:01.538232 25993 sys_catalog.cc:458] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e [sys.catalog]: This master's current role is: LEADER
I20260806 11:52:01.542917 26020 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:52:01.544359 26020 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:52:01.561615 26020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cadfc6bce7a9407ebb7b642d99bff63e: Generated new TSK 0
I20260806 11:52:01.562704 26020 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 11:52:01.602649 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.599424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35084 (local address 127.26.172.253:37611)
0806 11:52:01.599565 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.599570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.601396 (+ 1826us) server_negotiation.cc:407] Connection header received
0806 11:52:01.601636 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.601641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.601709 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.601768 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.602494 (+ 726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35084: BlockingRecv error: recv got EOF from 127.0.0.1:35084 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 11:52:01.604455 25965 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.600842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39542 (local address 127.26.172.252:43103)
0806 11:52:01.600969 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.600974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.603465 (+ 2491us) server_negotiation.cc:407] Connection header received
0806 11:52:01.603651 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.603654 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.603706 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.603762 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.604315 (+ 553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39542: BlockingRecv error: recv got EOF from 127.0.0.1:39542 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260806 11:52:01.606065 25753 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.599955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40328 (local address 127.26.172.254:32991)
0806 11:52:01.600091 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.600096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.605086 (+ 4990us) server_negotiation.cc:407] Connection header received
0806 11:52:01.605266 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.605272 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.605328 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.605381 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.605917 (+ 536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40328: BlockingRecv error: recv got EOF from 127.0.0.1:40328 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260806 11:52:01.611238 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.609424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35098 (local address 127.26.172.253:37611)
0806 11:52:01.609540 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.609544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.610110 (+ 566us) server_negotiation.cc:407] Connection header received
0806 11:52:01.610373 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.610377 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.610467 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.610523 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.611122 (+ 599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35098: BlockingRecv error: recv got EOF from 127.0.0.1:35098 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260806 11:52:01.616971 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.615145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35110 (local address 127.26.172.253:37611)
0806 11:52:01.615263 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.615268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.615879 (+ 611us) server_negotiation.cc:407] Connection header received
0806 11:52:01.616143 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.616147 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.616221 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.616281 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.616824 (+ 543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35110: BlockingRecv error: recv got EOF from 127.0.0.1:35110 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260806 11:52:01.623364 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.621602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35118 (local address 127.26.172.253:37611)
0806 11:52:01.621723 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.621728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.622338 (+ 610us) server_negotiation.cc:407] Connection header received
0806 11:52:01.622542 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.622546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.622598 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.622651 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.623243 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35118: BlockingRecv error: recv got EOF from 127.0.0.1:35118 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 11:52:01.632807 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.630206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35132 (local address 127.26.172.253:37611)
0806 11:52:01.630387 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.630392 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.631692 (+ 1300us) server_negotiation.cc:407] Connection header received
0806 11:52:01.631930 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.631934 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.632009 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.632065 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.632676 (+ 611us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35132: BlockingRecv error: recv got EOF from 127.0.0.1:35132 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 11:52:01.645737 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.643874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35142 (local address 127.26.172.253:37611)
0806 11:52:01.644017 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.644022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.644658 (+ 636us) server_negotiation.cc:407] Connection header received
0806 11:52:01.644885 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.644889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.644946 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.645015 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.645618 (+ 603us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35142: BlockingRecv error: recv got EOF from 127.0.0.1:35142 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260806 11:52:01.666982 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.664973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35144 (local address 127.26.172.253:37611)
0806 11:52:01.665115 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.665121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.665761 (+ 640us) server_negotiation.cc:407] Connection header received
0806 11:52:01.666013 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.666018 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.666078 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.666140 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.666772 (+ 632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35144: BlockingRecv error: recv got EOF from 127.0.0.1:35144 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260806 11:52:01.703974 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.702163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35158 (local address 127.26.172.253:37611)
0806 11:52:01.702295 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.702300 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.702762 (+ 462us) server_negotiation.cc:407] Connection header received
0806 11:52:01.702946 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.702951 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.703042 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.703159 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.703794 (+ 635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35158: BlockingRecv error: recv got EOF from 127.0.0.1:35158 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260806 11:52:01.772045 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.770577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35164 (local address 127.26.172.253:37611)
0806 11:52:01.770887 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.770894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.770993 (+ 99us) server_negotiation.cc:407] Connection header received
0806 11:52:01.771085 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.771088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.771159 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.771246 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.771854 (+ 608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35164: BlockingRecv error: recv got EOF from 127.0.0.1:35164 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
W20260806 11:52:01.904247 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:01.902927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35166 (local address 127.26.172.253:37611)
0806 11:52:01.903127 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:01.903131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:01.903162 (+ 31us) server_negotiation.cc:407] Connection header received
0806 11:52:01.903276 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:01.903279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:01.903344 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:01.903461 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:01.904060 (+ 599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35166: BlockingRecv error: recv got EOF from 127.0.0.1:35166 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 11:52:02.164518 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:02.163111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35180 (local address 127.26.172.253:37611)
0806 11:52:02.163330 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:02.163336 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:02.163371 (+ 35us) server_negotiation.cc:407] Connection header received
0806 11:52:02.163462 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:02.163465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:02.163530 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:02.163650 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:02.164324 (+ 674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35180: BlockingRecv error: recv got EOF from 127.0.0.1:35180 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 11:52:02.405059 25988 catalog_manager.cc:1259] Loaded cluster ID: e865346690554851bc8c733b5ecc9717
I20260806 11:52:02.405238 25988 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee: loading cluster ID for follower catalog manager: success
I20260806 11:52:02.408069 25988 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee: acquiring CA information for follower catalog manager: success
I20260806 11:52:02.409812 25988 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 36a5b5f4839e437f972c409a406028ee: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 11:52:02.503254 26046 catalog_manager.cc:1259] Loaded cluster ID: e865346690554851bc8c733b5ecc9717
I20260806 11:52:02.503433 26046 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf: loading cluster ID for follower catalog manager: success
I20260806 11:52:02.505908 26046 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf: acquiring CA information for follower catalog manager: success
I20260806 11:52:02.507501 26046 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2aa8b1e432dd4931a53473da33a38ebf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 11:52:02.684101 26154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:02.679463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35182 (local address 127.26.172.253:37611)
0806 11:52:02.679843 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:02.679849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:02.679874 (+ 25us) server_negotiation.cc:407] Connection header received
0806 11:52:02.679960 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:02.679963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:02.680142 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:02.680283 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:52:02.680606 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:02.681190 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:02.682128 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:02.682370 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:02.682484 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:02.682956 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:52:02.683589 (+ 633us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:52:02.683748 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:02.683794 (+ 46us) server_negotiation.cc:299] Negotiation successful
0806 11:52:02.683869 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":100,"threads_started":1}
I20260806 11:52:02.694355 26162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:02.689047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39544 (local address 127.26.172.252:43103)
0806 11:52:02.689399 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:02.689406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:02.689524 (+ 118us) server_negotiation.cc:407] Connection header received
0806 11:52:02.689815 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:02.689818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:02.689988 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:02.690174 (+ 186us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:52:02.690478 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:02.691101 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:02.692286 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:02.692536 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:02.692662 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:02.693053 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:52:02.693768 (+ 715us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:52:02.694015 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:02.694051 (+ 36us) server_negotiation.cc:299] Negotiation successful
0806 11:52:02.694128 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":89,"threads_started":1}
I20260806 11:52:02.703955 26162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:02.700011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39546 (local address 127.26.172.252:43103)
0806 11:52:02.700175 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:02.700181 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:02.700195 (+ 14us) server_negotiation.cc:407] Connection header received
0806 11:52:02.700361 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:02.700364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:02.700432 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:02.700520 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:52:02.700817 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:02.701386 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:02.702639 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:02.702982 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:02.703107 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:02.703410 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:52:02.703502 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:52:02.703591 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:02.703686 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 11:52:02.703745 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 11:52:02.705737 26154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:02.699092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35198 (local address 127.26.172.253:37611)
0806 11:52:02.699268 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:02.699273 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:02.699573 (+ 300us) server_negotiation.cc:407] Connection header received
0806 11:52:02.699716 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:02.699721 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:02.699809 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:02.699921 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:52:02.700480 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:02.701411 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:02.703136 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:02.703508 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:02.703594 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:02.704291 (+ 697us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:52:02.704399 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:52:02.704502 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:02.705485 (+ 983us) server_negotiation.cc:299] Negotiation successful
0806 11:52:02.705591 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 11:52:02.705750 26168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:02.698985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40338 (local address 127.26.172.254:32991)
0806 11:52:02.699335 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:02.699342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:02.699457 (+ 115us) server_negotiation.cc:407] Connection header received
0806 11:52:02.699784 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:02.699788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:02.700021 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:02.700178 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:52:02.700571 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:02.701404 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:02.703121 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:02.703496 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:02.703600 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:02.704405 (+ 805us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:52:02.704857 (+ 452us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:52:02.704977 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:02.705419 (+ 442us) server_negotiation.cc:299] Negotiation successful
0806 11:52:02.705510 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":109,"threads_started":1}
I20260806 11:52:02.717384 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 25653
I20260806 11:52:02.741052 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 25757
I20260806 11:52:02.755254 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 25862
2026-08-06T11:52:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3742 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 11:52:02 dist-test-slave-7z32 krb5kdc[26176](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 11:52:02 dist-test-slave-7z32 krb5kdc[26176](info): set up 2 sockets
Aug 06 11:52:02 dist-test-slave-7z32 krb5kdc[26176](info): commencing operation
krb5kdc: starting...
W20260806 11:52:04.076617 27315 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/test-user.keytab.
Aug 06 11:52:04 dist-test-slave-7z32 krb5kdc[26176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T11:52:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T11:52:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.172.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
Entry for principal kudu/127.26.172.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab.
I20260806 11:52:04.243433 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:41067
--webserver_interface=127.26.172.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:41067,127.26.172.253:34189,127.26.172.252:41875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 11:52:04.368592 26198 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 11:52:04.369004 26198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:52:04.369055 26198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:52:04.369130 26198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:52:04.373384 26198 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:52:04.373522 26198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:52:04.373562 26198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:52:04.373605 26198 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:52:04.373636 26198 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:52:04.379504 26198 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:41067,127.26.172.253:34189,127.26.172.252:41875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.254.keytab
--principal=kudu/127.26.172.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.254:41067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.172.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:52:04.380807 26198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:52:04.382000 26198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:52:04.393065 26206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:04.393114 26208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:04.393065 26205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:52:04.393411 26198 server_base.cc:1034] running on GCE node
I20260806 11:52:04.394342 26198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:52:04.395722 26198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:52:04.396909 26198 hybrid_clock.cc:648] HybridClock initialized: now 1786017124396888 us; error 48 us; skew 500 ppm
Aug 06 11:52:04 dist-test-slave-7z32 krb5kdc[26176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:52:04.400492 26198 init.cc:377] Logged in from keytab as kudu/127.26.172.254@KRBTEST.COM (short username kudu)
I20260806 11:52:04.401686 26198 webserver.cc:460] Webserver started at http://127.26.172.254:36829/ using document root <none> and password file <none>
I20260806 11:52:04.402372 26198 fs_manager.cc:359] Metadata directory not provided
I20260806 11:52:04.402448 26198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:52:04.402706 26198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:52:04.405128 26198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/data/instance:
uuid: "c8cc5019b89c4d958736206c2ce16962"
format_stamp: "Formatted at 2026-08-06 11:52:04 on dist-test-slave-7z32"
server_key: "8bcc0d547bad252ad821273c17d16beb"
server_key_iv: "5581bba1fdaf0d23906e2ecbbef0efe6"
server_key_version: "encryptionkey@0"
I20260806 11:52:04.405790 26198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/wal/instance:
uuid: "c8cc5019b89c4d958736206c2ce16962"
format_stamp: "Formatted at 2026-08-06 11:52:04 on dist-test-slave-7z32"
server_key: "8bcc0d547bad252ad821273c17d16beb"
server_key_iv: "5581bba1fdaf0d23906e2ecbbef0efe6"
server_key_version: "encryptionkey@0"
I20260806 11:52:04.412429 26198 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 11:52:04.416311 26218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:52:04.418272 26198 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 11:52:04.418479 26198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/wal
uuid: "c8cc5019b89c4d958736206c2ce16962"
format_stamp: "Formatted at 2026-08-06 11:52:04 on dist-test-slave-7z32"
server_key: "8bcc0d547bad252ad821273c17d16beb"
server_key_iv: "5581bba1fdaf0d23906e2ecbbef0efe6"
server_key_version: "encryptionkey@0"
I20260806 11:52:04.418635 26198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:52:04.436671 26198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:52:04.440949 26198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:52:04.441205 26198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:52:04.449976 26198 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.254:41067
I20260806 11:52:04.450479 26293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.254:41067 every 8 connection(s)
I20260806 11:52:04.451262 26198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/data/info.pb
I20260806 11:52:04.454708 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 26198
I20260806 11:52:04.454916 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-0/wal/instance
I20260806 11:52:04.455271 27315 external_mini_cluster.cc:1428] Setting key a1e6277e51870f00f20b0d163dfb41c1
I20260806 11:52:04.455502 26294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:52:04.461124 26294 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.172.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.253@KRBTEST.COM" created.
Aug 06 11:52:04 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:52:04.483662 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.464438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53242 (local address 127.26.172.254:41067)
0806 11:52:04.465273 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:04.465296 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:04.465621 (+ 325us) server_negotiation.cc:407] Connection header received
0806 11:52:04.467142 (+ 1521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:04.467149 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:04.467463 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:04.467765 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:04.469237 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.470912 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.472257 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.472690 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.472893 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:04.476435 (+ 3542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:04.476444 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:04.476462 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:04.476491 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:04.479181 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:04.479888 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:04.479897 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:04.479899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:04.480053 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:04.480440 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:04.480443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:04.480446 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:04.481079 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:04.481269 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:04.481756 (+ 487us) server_negotiation.cc:299] Negotiation successful
0806 11:52:04.482129 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":230,"threads_started":1}
I20260806 11:52:04.483662 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.464438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41067 (local address 127.0.0.1:53242)
0806 11:52:04.465393 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.465459 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:04.466659 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:04.467794 (+ 1135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:04.467801 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:04.468286 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:04.468864 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:04.468891 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.471137 (+ 2246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.471141 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:04.472068 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:04.472081 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.472906 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.472909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:04.473012 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:04.473713 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:04.473732 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:04.476191 (+ 2459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:04.479371 (+ 3180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:04.479382 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:04.479397 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:04.479744 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:04.480168 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:04.480173 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:04.480176 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:04.480322 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:04.481238 (+ 916us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:04.481247 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:04.481425 (+ 178us) client_negotiation.cc:769] Sending connection context
0806 11:52:04.481670 (+ 245us) client_negotiation.cc:240] Negotiation successful
0806 11:52:04.482240 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"mutex_wait_us":143,"spinlock_wait_cycles":51968,"thread_start_us":230,"threads_started":1}
I20260806 11:52:04.487619 26294 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } has no permanent_uuid. Determining permanent_uuid...
I20260806 11:52:04.488929 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.488524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51482)
0806 11:52:04.488708 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.488824 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 11:52:04.489233 26221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab.
Entry for principal kudu/127.26.172.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab.
I20260806 11:52:04.490455 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.490175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51486)
0806 11:52:04.490305 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.490369 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 11:52:04.490623 26294 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:34189: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
I20260806 11:52:04.491498 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.253:34189
--webserver_interface=127.26.172.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab
--principal=kudu/127.26.172.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:41067,127.26.172.253:34189,127.26.172.252:41875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 11:52:04.540002 26294 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } attempt: 1
I20260806 11:52:04.541443 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.540926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51494)
0806 11:52:04.541216 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.541323 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260806 11:52:04.542603 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.542298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51500)
0806 11:52:04.542448 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.542517 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260806 11:52:04.542775 26294 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:34189: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
I20260806 11:52:04.611006 26294 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } attempt: 2
I20260806 11:52:04.612186 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.611812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51504)
0806 11:52:04.612003 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.612085 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 11:52:04.612970 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.612741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51506)
0806 11:52:04.612853 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.612906 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260806 11:52:04.613111 26294 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:34189: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
W20260806 11:52:04.620878 26304 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 11:52:04.621295 26304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:52:04.621376 26304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:52:04.621541 26304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:52:04.626227 26304 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:52:04.626359 26304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:52:04.626396 26304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:52:04.626436 26304 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:52:04.626467 26304 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:52:04.632622 26304 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:41067,127.26.172.253:34189,127.26.172.252:41875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.253.keytab
--principal=kudu/127.26.172.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.253:34189
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.172.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:52:04.633991 26304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:52:04.635293 26304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:52:04.645953 26313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:04.646009 26315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:04.646003 26312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:52:04.646557 26304 server_base.cc:1034] running on GCE node
I20260806 11:52:04.647287 26304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:52:04.648593 26304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:52:04.649811 26304 hybrid_clock.cc:648] HybridClock initialized: now 1786017124649786 us; error 51 us; skew 500 ppm
Aug 06 11:52:04 dist-test-slave-7z32 krb5kdc[26176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:52:04.653487 26304 init.cc:377] Logged in from keytab as kudu/127.26.172.253@KRBTEST.COM (short username kudu)
I20260806 11:52:04.654639 26304 webserver.cc:460] Webserver started at http://127.26.172.253:33017/ using document root <none> and password file <none>
I20260806 11:52:04.655396 26304 fs_manager.cc:359] Metadata directory not provided
I20260806 11:52:04.655505 26304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:52:04.655741 26304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:52:04.658054 26304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/data/instance:
uuid: "878035cc5e0349b1984bcd392633dd78"
format_stamp: "Formatted at 2026-08-06 11:52:04 on dist-test-slave-7z32"
server_key: "9c0068d1a16c36df1a62d0b6179795fd"
server_key_iv: "f8af39e7415c956868e333a029b32533"
server_key_version: "encryptionkey@0"
I20260806 11:52:04.658728 26304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/wal/instance:
uuid: "878035cc5e0349b1984bcd392633dd78"
format_stamp: "Formatted at 2026-08-06 11:52:04 on dist-test-slave-7z32"
server_key: "9c0068d1a16c36df1a62d0b6179795fd"
server_key_iv: "f8af39e7415c956868e333a029b32533"
server_key_version: "encryptionkey@0"
I20260806 11:52:04.664213 26304 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 11:52:04.667807 26328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:52:04.669765 26304 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 11:52:04.670043 26304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/wal
uuid: "878035cc5e0349b1984bcd392633dd78"
format_stamp: "Formatted at 2026-08-06 11:52:04 on dist-test-slave-7z32"
server_key: "9c0068d1a16c36df1a62d0b6179795fd"
server_key_iv: "f8af39e7415c956868e333a029b32533"
server_key_version: "encryptionkey@0"
I20260806 11:52:04.670213 26304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:52:04.701279 26304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:52:04.704367 26294 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } attempt: 3
I20260806 11:52:04.705565 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.705018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51516)
0806 11:52:04.705323 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.705432 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260806 11:52:04.705734 26304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:52:04.705991 26304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:52:04.706810 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.706406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51532)
0806 11:52:04.706543 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.706689 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 11:52:04.707799 26294 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.253:34189: Network error: Client connection negotiation failed: client connection to 127.26.172.253:34189: connect: Connection refused (error 111)
I20260806 11:52:04.715445 26304 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.253:34189
I20260806 11:52:04.715937 26399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.253:34189 every 8 connection(s)
I20260806 11:52:04.716645 26304 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/data/info.pb
I20260806 11:52:04.720973 26400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:52:04.722765 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 26304
I20260806 11:52:04.723137 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-1/wal/instance
I20260806 11:52:04.723529 27315 external_mini_cluster.cc:1428] Setting key b62a42fb8b461cf53048fa9c3dbdbfd7
I20260806 11:52:04.727583 26400 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.172.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.172.252@KRBTEST.COM" created.
Aug 06 11:52:04 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:52:04.748716 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.730782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53246 (local address 127.26.172.254:41067)
0806 11:52:04.731026 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:04.731031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:04.732633 (+ 1602us) server_negotiation.cc:407] Connection header received
0806 11:52:04.734187 (+ 1554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:04.734191 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:04.734281 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:04.734419 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:04.736253 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.736945 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.738542 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.738931 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.739075 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:04.743157 (+ 4082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:04.743165 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:04.743172 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:04.743231 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:04.745540 (+ 2309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:04.746417 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:04.746427 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:04.746429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:04.746533 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:04.747115 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:04.747120 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:04.747121 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:04.747387 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:04.747522 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:04.748299 (+ 777us) server_negotiation.cc:299] Negotiation successful
0806 11:52:04.748491 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260806 11:52:04.749933 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.731461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41067 (local address 127.0.0.1:53246)
0806 11:52:04.732364 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.732441 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:04.733877 (+ 1436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:04.734687 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:04.734698 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:04.735315 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:04.736019 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:04.736039 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.737138 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.737142 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:04.738368 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:04.738380 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.739161 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.739166 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:04.739396 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:04.740255 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:04.740288 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:04.742709 (+ 2421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:04.745788 (+ 3079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:04.745807 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:04.745831 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:04.746260 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:04.746662 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:04.746671 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:04.746673 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:04.746956 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:04.747522 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:04.747533 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:04.747945 (+ 412us) client_negotiation.cc:769] Sending connection context
0806 11:52:04.748214 (+ 269us) client_negotiation.cc:240] Negotiation successful
0806 11:52:04.748720 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":206,"threads_started":1}
I20260806 11:52:04.752048 26400 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.172.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab.
Entry for principal kudu/127.26.172.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab.
I20260806 11:52:04.759088 27315 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
/tmp/dist-test-taskJj2CNI/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.252:41875
--webserver_interface=127.26.172.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab
--principal=kudu/127.26.172.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.172.212:37063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.172.254:41067,127.26.172.253:34189,127.26.172.252:41875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 11:52:04 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
I20260806 11:52:04.765643 26408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.753061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51548 (local address 127.26.172.253:34189)
0806 11:52:04.753554 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:04.753567 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:04.753590 (+ 23us) server_negotiation.cc:407] Connection header received
0806 11:52:04.753630 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:04.753635 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:04.753903 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:04.754044 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:04.754742 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.755776 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.756988 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.757554 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.757738 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:04.761174 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:04.761189 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:04.761210 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:04.761237 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:04.763442 (+ 2205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:04.763969 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:04.763979 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:04.763981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:04.764078 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:04.764387 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:04.764390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:04.764392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:04.764780 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:04.764965 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:04.765270 (+ 305us) server_negotiation.cc:299] Negotiation successful
0806 11:52:04.765437 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":182,"threads_started":1}
I20260806 11:52:04.765609 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.752853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51548)
0806 11:52:04.753099 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.753115 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:04.753215 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:04.754120 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:04.754123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:04.754337 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:04.754521 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:04.754529 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.755965 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.755968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:04.756706 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:04.756719 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.757831 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.757840 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:04.758013 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:04.758908 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:04.758925 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:04.760972 (+ 2047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:04.763593 (+ 2621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:04.763598 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:04.763601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:04.763833 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:04.764191 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:04.764195 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:04.764197 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:04.764282 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:04.764914 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:04.764917 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:04.765019 (+ 102us) client_negotiation.cc:769] Sending connection context
0806 11:52:04.765154 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 11:52:04.765352 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122}
I20260806 11:52:04.768893 26400 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } has no permanent_uuid. Determining permanent_uuid...
I20260806 11:52:04.770112 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.769697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50470)
0806 11:52:04.769893 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.770000 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260806 11:52:04.770385 26330 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
I20260806 11:52:04.771502 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.771249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50486)
0806 11:52:04.771373 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.771430 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 11:52:04.771718 26400 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:41875: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
I20260806 11:52:04.821062 26400 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } attempt: 1
I20260806 11:52:04.822599 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.822059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50494)
0806 11:52:04.822328 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.822420 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260806 11:52:04.823901 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.823535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50502)
0806 11:52:04.823710 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.823820 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260806 11:52:04.824141 26400 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:41875: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
I20260806 11:52:04.851014 26294 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } attempt: 4
Aug 06 11:52:04 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
I20260806 11:52:04.865016 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.851757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51558)
0806 11:52:04.852119 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.852143 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:04.852331 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:04.852918 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:04.852923 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:04.853247 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:04.853422 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:04.853431 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.854903 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.854911 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:04.855871 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:04.855887 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.856595 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.856599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:04.856801 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:04.857620 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:04.857637 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:04.859843 (+ 2206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:04.862646 (+ 2803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:04.862650 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:04.862652 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:04.863112 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:04.863606 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:04.863609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:04.863611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:04.863715 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:04.864433 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:04.864436 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:04.864575 (+ 139us) client_negotiation.cc:769] Sending connection context
0806 11:52:04.864680 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 11:52:04.864845 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201}
I20260806 11:52:04.865253 26408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.852000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.26.172.253:34189)
0806 11:52:04.852172 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:04.852176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:04.852236 (+ 60us) server_negotiation.cc:407] Connection header received
0806 11:52:04.852661 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:04.852664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:04.852728 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:04.852824 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:04.853607 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.854667 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.856093 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:04.856366 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:04.856525 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:04.860138 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:04.860144 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:04.860148 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:04.860198 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:04.862388 (+ 2190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:04.863260 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:04.863265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:04.863267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:04.863400 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:04.863851 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:04.863854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:04.863856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:04.864183 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:04.864321 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:04.864805 (+ 484us) server_negotiation.cc:299] Negotiation successful
0806 11:52:04.865036 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 11:52:04.866554 26294 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } has no permanent_uuid. Determining permanent_uuid...
I20260806 11:52:04.867758 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.867288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50508)
0806 11:52:04.867507 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.867620 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260806 11:52:04.868777 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.868452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50514)
0806 11:52:04.868613 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.868691 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 11:52:04.869033 26294 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:41875: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
I20260806 11:52:04.892403 26400 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } attempt: 2
I20260806 11:52:04.893524 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.893159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50528)
0806 11:52:04.893352 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.893429 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 11:52:04.894492 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.894244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50544)
0806 11:52:04.894375 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.894433 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 11:52:04.894690 26400 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:41875: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
W20260806 11:52:04.916250 26409 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 11:52:04.916708 26409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 11:52:04.916782 26409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 11:52:04.916880 26409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 11:52:04.922070 26409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 11:52:04.922204 26409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 11:52:04.922226 26409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 11:52:04.922246 26409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 11:52:04.922264 26409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 11:52:04.928287 26294 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } attempt: 1
I20260806 11:52:04.929894 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.928991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50548)
0806 11:52:04.929494 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.929709 (+ 215us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260806 11:52:04.931030 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.930728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50560)
0806 11:52:04.930884 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.930956 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260806 11:52:04.931263 26294 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:41875: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
I20260806 11:52:04.931650 26409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.172.212:37063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.172.254:41067,127.26.172.253:34189,127.26.172.252:41875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/krb5kdc/kudu_127.26.172.252.keytab
--principal=kudu/127.26.172.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.172.252:41875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.172.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 06 Aug 2026 10:32:43 UTC on ccycloud.quasar-kjnemz.root.comops.site
build id 4570061
I20260806 11:52:04.933303 26409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 11:52:04.934716 26409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 11:52:04.946015 26418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:04.946027 26420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 11:52:04.946027 26417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 11:52:04.946136 26409 server_base.cc:1034] running on GCE node
I20260806 11:52:04.947315 26409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 11:52:04.948729 26409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 11:52:04.949968 26409 hybrid_clock.cc:648] HybridClock initialized: now 1786017124949950 us; error 53 us; skew 500 ppm
Aug 06 11:52:04 dist-test-slave-7z32 krb5kdc[26176](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 11:52:04.953552 26409 init.cc:377] Logged in from keytab as kudu/127.26.172.252@KRBTEST.COM (short username kudu)
I20260806 11:52:04.955109 26409 webserver.cc:460] Webserver started at http://127.26.172.252:43999/ using document root <none> and password file <none>
I20260806 11:52:04.955941 26409 fs_manager.cc:359] Metadata directory not provided
I20260806 11:52:04.956034 26409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 11:52:04.956336 26409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 11:52:04.959270 26409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/data/instance:
uuid: "a2f42d39da514c1f9af7e9c318c5a7aa"
format_stamp: "Formatted at 2026-08-06 11:52:04 on dist-test-slave-7z32"
server_key: "ab82ff9668dce1eeca9107be71c5880d"
server_key_iv: "b50ee2290f9473bf56ea73fdfa5cbf38"
server_key_version: "encryptionkey@0"
I20260806 11:52:04.960224 26409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/wal/instance:
uuid: "a2f42d39da514c1f9af7e9c318c5a7aa"
format_stamp: "Formatted at 2026-08-06 11:52:04 on dist-test-slave-7z32"
server_key: "ab82ff9668dce1eeca9107be71c5880d"
server_key_iv: "b50ee2290f9473bf56ea73fdfa5cbf38"
server_key_version: "encryptionkey@0"
I20260806 11:52:04.965869 26409 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 11:52:04.969762 26429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 11:52:04.971908 26409 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 11:52:04.972144 26409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/data,/tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/wal
uuid: "a2f42d39da514c1f9af7e9c318c5a7aa"
format_stamp: "Formatted at 2026-08-06 11:52:04 on dist-test-slave-7z32"
server_key: "ab82ff9668dce1eeca9107be71c5880d"
server_key_iv: "b50ee2290f9473bf56ea73fdfa5cbf38"
server_key_version: "encryptionkey@0"
I20260806 11:52:04.972344 26409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 11:52:04.985908 26400 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } attempt: 3
I20260806 11:52:04.987205 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.986695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50564)
0806 11:52:04.987024 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.987110 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260806 11:52:04.988322 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.988011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50568)
0806 11:52:04.988184 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.988241 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260806 11:52:04.988544 26400 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:41875: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
I20260806 11:52:04.998214 26409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 11:52:04.998584 26294 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } attempt: 2
I20260806 11:52:04.999915 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:04.999387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50576)
0806 11:52:04.999658 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:04.999793 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260806 11:52:05.001062 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.000704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50592)
0806 11:52:05.000886 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:05.000975 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 11:52:05.001489 26294 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.172.252:41875: Network error: Client connection negotiation failed: client connection to 127.26.172.252:41875: connect: Connection refused (error 111)
I20260806 11:52:05.003756 26409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 11:52:05.003978 26409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 11:52:05.014300 26409 rpc_server.cc:307] RPC server started. Bound to: 127.26.172.252:41875
I20260806 11:52:05.014423 26515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.172.252:41875 every 8 connection(s)
I20260806 11:52:05.015682 26409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/data/info.pb
I20260806 11:52:05.019482 26516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 11:52:05.020545 27315 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu as pid 26409
I20260806 11:52:05.020756 27315 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJj2CNI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786016786541679-27315-0/minicluster-data/master-2/wal/instance
I20260806 11:52:05.021133 27315 external_mini_cluster.cc:1428] Setting key 81a8d5bc42f6cbc4e0bb2d945befa227
I20260806 11:52:05.025116 26516 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:52:05 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
Aug 06 11:52:05 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:52:05.040764 26520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.023227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50594 (local address 127.26.172.252:41875)
0806 11:52:05.023913 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.023939 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.023992 (+ 53us) server_negotiation.cc:407] Connection header received
0806 11:52:05.024913 (+ 921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.024941 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.025424 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.025855 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.026879 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.028237 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.029286 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.029999 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.030215 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.033628 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.033636 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.033663 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.033699 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.036277 (+ 2578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.036866 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.036876 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.036885 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.037098 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.037662 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.037666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.037667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.038453 (+ 786us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.038641 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.039236 (+ 595us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.039655 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":465,"spinlock_wait_cycles":1792,"thread_start_us":165,"threads_started":1}
I20260806 11:52:05.041556 26521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.027427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.254:41067 (local address 127.0.0.1:53254)
0806 11:52:05.028056 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:05.028123 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:05.028292 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:05.029663 (+ 1371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:05.029669 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:05.030212 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:05.030518 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:05.030526 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.031554 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.031558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:05.032324 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:05.032334 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.032936 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.032940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:05.033089 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.033918 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:05.033939 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:05.036359 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:05.039083 (+ 2724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:05.039091 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:05.039097 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:05.039424 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:05.039772 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:05.039775 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:05.039777 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:05.039881 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:05.040602 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:05.040609 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:05.040756 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 11:52:05.040944 (+ 188us) client_negotiation.cc:240] Negotiation successful
0806 11:52:05.041422 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":68,"thread_start_us":220,"threads_started":1}
I20260806 11:52:05.042553 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.027522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53254 (local address 127.26.172.254:41067)
0806 11:52:05.027710 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.027715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.028237 (+ 522us) server_negotiation.cc:407] Connection header received
0806 11:52:05.029359 (+ 1122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.029362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.029430 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.029526 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.030766 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.031405 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.032481 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.032736 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.032865 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.036593 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.036598 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.036602 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.036652 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.038950 (+ 2298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.039565 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.039569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.039571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.039665 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.040059 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.040065 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.040070 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.040468 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.040577 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.042266 (+ 1689us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.042430 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 11:52:05.044147 26516 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:52:05 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
Aug 06 11:52:05 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.254@KRBTEST.COM
I20260806 11:52:05.056632 26521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.045085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.253:34189 (local address 127.0.0.1:51570)
0806 11:52:05.045205 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:05.045222 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:05.045325 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:05.045638 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:05.045642 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:05.045911 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:05.046107 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:05.046116 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.047460 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.047463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:05.048344 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:05.048357 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.049075 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.049079 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:05.049190 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.049932 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:05.049954 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:05.051719 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:05.054433 (+ 2714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:05.054437 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:05.054439 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:05.054680 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:05.055175 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:05.055179 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:05.055183 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:05.055293 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:05.055917 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:05.055919 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:05.056079 (+ 160us) client_negotiation.cc:769] Sending connection context
0806 11:52:05.056221 (+ 142us) client_negotiation.cc:240] Negotiation successful
0806 11:52:05.056421 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 11:52:05.056906 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.044712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53258 (local address 127.26.172.254:41067)
0806 11:52:05.044885 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.044893 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.045059 (+ 166us) server_negotiation.cc:407] Connection header received
0806 11:52:05.045250 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.045255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.045322 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.045413 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.046441 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.047285 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.048533 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.048907 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.049033 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.052621 (+ 3588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.052629 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.052637 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.052681 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.054647 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.055220 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.055224 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.055226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.055319 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.055665 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.055669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.055671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.055962 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.056404 (+ 442us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.056497 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.056678 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 11:52:05.056906 26408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.045178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51570 (local address 127.26.172.253:34189)
0806 11:52:05.045323 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.045328 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.045346 (+ 18us) server_negotiation.cc:407] Connection header received
0806 11:52:05.045436 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.045439 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.045487 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.045582 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.046273 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.047284 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.048533 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.048907 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.049033 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.051926 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.051931 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.051935 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.051982 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.054181 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.054923 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.054927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.054930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.055042 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.055409 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.055416 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.055421 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.055769 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.055896 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.056432 (+ 536us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.056678 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 11:52:05.057955 26516 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 11:52:05 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.252@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
Aug 06 11:52:05 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.172.253@KRBTEST.COM
I20260806 11:52:05.070791 26520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.058780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50602 (local address 127.26.172.252:41875)
0806 11:52:05.058917 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.058923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.059055 (+ 132us) server_negotiation.cc:407] Connection header received
0806 11:52:05.059206 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.059209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.059275 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.059375 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.060012 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.061428 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.062523 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.062978 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.063152 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.066162 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.066166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.066175 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.066206 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.068466 (+ 2260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.069046 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.069051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.069053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.069163 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.069528 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.069532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.069534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.069846 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.069939 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.070329 (+ 390us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.070506 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 11:52:05.070963 26408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.058943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51572 (local address 127.26.172.253:34189)
0806 11:52:05.059179 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.059184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.059206 (+ 22us) server_negotiation.cc:407] Connection header received
0806 11:52:05.059242 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.059245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.059293 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.059382 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.060209 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.061144 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.062344 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.062785 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.062967 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.066714 (+ 3747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.066718 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.066720 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.066749 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.068629 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.069305 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.069309 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.069311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.069405 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.069761 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.069763 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.069765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.070049 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.070382 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.070559 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.070712 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260806 11:52:05.070784 26521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.058770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50602)
0806 11:52:05.058966 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:05.058984 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:05.059086 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:05.059449 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:05.059452 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:05.059672 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:05.059837 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:05.059847 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.061560 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.061564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:05.062374 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:05.062391 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.063174 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.063178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:05.063272 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.063993 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:05.064010 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:05.065870 (+ 1860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:05.068629 (+ 2759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:05.068633 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:05.068636 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:05.068911 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:05.069305 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:05.069309 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:05.069311 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:05.069416 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:05.069965 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:05.069969 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:05.070087 (+ 118us) client_negotiation.cc:769] Sending connection context
0806 11:52:05.070218 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 11:52:05.070420 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143}
I20260806 11:52:05.076071 26516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa: Bootstrap starting.
I20260806 11:52:05.076085 27315 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 11:52:05.077744 26256 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c8cc5019b89c4d958736206c2ce16962"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53258
I20260806 11:52:05.079819 26516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa: Neither blocks nor log segments found. Creating new log.
I20260806 11:52:05.080860 26516 log.cc:824] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa: Log is configured to *not* fsync() on all Append() calls
I20260806 11:52:05.083976 26516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa: No bootstrap required, opened a new log
I20260806 11:52:05.087903 26516 raft_consensus.cc:348] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } }
I20260806 11:52:05.088223 26516 raft_consensus.cc:729] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2f42d39da514c1f9af7e9c318c5a7aa, State: Initialized, Role: FOLLOWER
I20260806 11:52:05.088676 26516 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } }
I20260806 11:52:05.089535 26523 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } } }
I20260806 11:52:05.089828 26523 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:05.090502 26516 sys_catalog.cc:564] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [sys.catalog]: configured and running, proceeding with master startup.
W20260806 11:52:05.097342 26537 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:52:05.097484 26537 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:52:05.095701 26409 master_runner.cc:186] Error getting master registration for 127.26.172.254:41067: OK, instance_id { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" instance_seqno: 1786017124447600 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 11:52:05.100385 26409 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 11:52:05.101711 26294 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } attempt: 3
Aug 06 11:52:05 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.254@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
I20260806 11:52:05.112282 26520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.102588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.26.172.252:41875)
0806 11:52:05.103068 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.103072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.103085 (+ 13us) server_negotiation.cc:407] Connection header received
0806 11:52:05.103133 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.103135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.103177 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.103278 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.103811 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.104334 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.105156 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.105386 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.105501 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.108283 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.108288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.108291 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.108354 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.110151 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.110687 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.110692 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.110694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.110788 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.111191 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.111196 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.111198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.111495 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.111628 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.111948 (+ 320us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.112093 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396}
I20260806 11:52:05.112282 26299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.102443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50604)
0806 11:52:05.102695 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:05.102712 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:05.102898 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:05.103338 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:05.103341 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:05.103572 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:05.103674 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:05.103679 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.104458 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.104463 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:05.105017 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:05.105026 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.105522 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.105526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:05.105611 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.106196 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:05.106209 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:05.108078 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:05.110306 (+ 2228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:05.110310 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:05.110313 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:05.110563 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:05.110963 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:05.110966 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:05.110968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:05.111079 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:05.111617 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:05.111621 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:05.111748 (+ 127us) client_negotiation.cc:769] Sending connection context
0806 11:52:05.111883 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 11:52:05.112081 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148}
I20260806 11:52:05.116091 26294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962: Bootstrap starting.
I20260806 11:52:05.118907 26294 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962: Neither blocks nor log segments found. Creating new log.
I20260806 11:52:05.119796 26294 log.cc:824] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962: Log is configured to *not* fsync() on all Append() calls
I20260806 11:52:05.121955 26294 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962: No bootstrap required, opened a new log
I20260806 11:52:05.125008 26294 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } }
I20260806 11:52:05.125277 26294 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8cc5019b89c4d958736206c2ce16962, State: Initialized, Role: FOLLOWER
I20260806 11:52:05.125730 26294 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } }
I20260806 11:52:05.126606 26540 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } } }
I20260806 11:52:05.126893 26540 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:05.127678 26294 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:52:05.127830 26256 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 11:52:05.128007 26256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:52:05.129845 26256 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } }
I20260806 11:52:05.131755 26400 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } attempt: 4
W20260806 11:52:05.135933 26557 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:52:05.136053 26557 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:52:05.136608 26198 master_runner.cc:186] Error getting master registration for 127.26.172.253:34189: OK, instance_id { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" instance_seqno: 1786017124712976 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 11:52:05.141970 26198 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 06 11:52:05 dist-test-slave-7z32 krb5kdc[26176](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786017124, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.172.253@KRBTEST.COM for kudu/127.26.172.252@KRBTEST.COM
I20260806 11:52:05.143105 26471 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8cc5019b89c4d958736206c2ce16962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa"
I20260806 11:52:05.143478 26471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:52:05.145521 26471 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8cc5019b89c4d958736206c2ce16962 in term 1.
I20260806 11:52:05.146343 26221 leader_election.cc:302] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2f42d39da514c1f9af7e9c318c5a7aa, c8cc5019b89c4d958736206c2ce16962; no voters:
I20260806 11:52:05.146859 26540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 11:52:05.147149 26540 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [term 1 LEADER]: Becoming Leader. State: Replica: c8cc5019b89c4d958736206c2ce16962, State: Running, Role: LEADER
I20260806 11:52:05.147639 26540 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } }
I20260806 11:52:05.149919 26520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.132609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50608 (local address 127.26.172.252:41875)
0806 11:52:05.132863 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.132870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.132889 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:52:05.132940 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.132943 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.132995 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.133080 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.136671 (+ 3591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.137629 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.139062 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.139434 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.139558 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.142685 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.142690 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.142693 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.142727 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.144924 (+ 2197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.145838 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.145842 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.145846 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.146044 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.146650 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.146653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.146655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.147289 (+ 634us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.147831 (+ 542us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.148465 (+ 634us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.149192 (+ 727us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260806 11:52:05.149992 26406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.132413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.172.252:41875 (local address 127.0.0.1:50608)
0806 11:52:05.132639 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 11:52:05.132658 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 11:52:05.132763 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 11:52:05.134348 (+ 1585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 11:52:05.134352 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 11:52:05.134632 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0806 11:52:05.134766 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:05.134774 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.137839 (+ 3065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.137846 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:05.138806 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 11:52:05.138868 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.139758 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.139764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 11:52:05.139859 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.140585 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 11:52:05.140608 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 11:52:05.142480 (+ 1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 11:52:05.145130 (+ 2650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:05.145135 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:05.145137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:05.145650 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:05.146284 (+ 634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 11:52:05.146287 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 11:52:05.146289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 11:52:05.146455 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 11:52:05.147500 (+ 1045us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 11:52:05.147504 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 11:52:05.147883 (+ 379us) client_negotiation.cc:769] Sending connection context
0806 11:52:05.148500 (+ 617us) client_negotiation.cc:240] Negotiation successful
0806 11:52:05.149278 (+ 778us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260806 11:52:05.150511 26540 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8cc5019b89c4d958736206c2ce16962. Latest consensus state: current_term: 1 leader_uuid: "c8cc5019b89c4d958736206c2ce16962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } } }
I20260806 11:52:05.150715 26540 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [sys.catalog]: This master's current role is: LEADER
I20260806 11:52:05.151700 26256 leader_election.cc:288] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [CANDIDATE]: Term 1 election: Requested vote from peers 878035cc5e0349b1984bcd392633dd78 (127.26.172.253:34189), a2f42d39da514c1f9af7e9c318c5a7aa (127.26.172.252:41875)
I20260806 11:52:05.154310 26400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78: Bootstrap starting.
I20260806 11:52:05.157624 26564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 11:52:05.158023 26400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78: Neither blocks nor log segments found. Creating new log.
I20260806 11:52:05.159087 26564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 11:52:05.159910 26400 log.cc:824] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78: Log is configured to *not* fsync() on all Append() calls
I20260806 11:52:05.163275 26400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78: No bootstrap required, opened a new log
I20260806 11:52:05.174085 26400 raft_consensus.cc:348] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } }
I20260806 11:52:05.175988 26400 raft_consensus.cc:729] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 878035cc5e0349b1984bcd392633dd78, State: Initialized, Role: FOLLOWER
I20260806 11:52:05.176517 26400 consensus_queue.cc:260] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } }
I20260806 11:52:05.178756 26408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.155293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51576 (local address 127.26.172.253:34189)
0806 11:52:05.155542 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.155548 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.164064 (+ 8516us) server_negotiation.cc:407] Connection header received
0806 11:52:05.164672 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.164676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.164735 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.164795 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.166299 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.167288 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.168789 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.169258 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.169433 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.172092 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.172099 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.172102 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.172169 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.174673 (+ 2504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.176424 (+ 1751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.176429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.176431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.176574 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.177255 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.177259 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.177261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.177534 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.177664 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.178403 (+ 739us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.178567 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 11:52:05.180682 26300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.156845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53264 (local address 127.26.172.254:41067)
0806 11:52:05.157043 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.157049 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.167384 (+ 10335us) server_negotiation.cc:407] Connection header received
0806 11:52:05.167658 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.167663 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.167740 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.167803 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.169112 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.169946 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.171775 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.172234 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.172387 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.175973 (+ 3586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.175980 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.175984 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.176036 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.178300 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.179034 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.179048 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.179050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.179160 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.179506 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.179510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.179512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.179785 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.179916 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.180312 (+ 396us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.180476 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 11:52:05.181356 26400 sys_catalog.cc:564] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 11:52:05.181478 26365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8cc5019b89c4d958736206c2ce16962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "878035cc5e0349b1984bcd392633dd78"
I20260806 11:52:05.181756 26365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [term 0 FOLLOWER]: Advancing to term 1
I20260806 11:52:05.183751 26365 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8cc5019b89c4d958736206c2ce16962 in term 1.
I20260806 11:52:05.192530 26520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:05.156019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50616 (local address 127.26.172.252:41875)
0806 11:52:05.159266 (+ 3247us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.159273 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.166937 (+ 7664us) server_negotiation.cc:407] Connection header received
0806 11:52:05.167014 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.167018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.167076 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.167161 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.177271 (+ 10110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.178031 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.184379 (+ 6348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:05.184785 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:05.184888 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:05.187392 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 11:52:05.187407 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 11:52:05.187410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 11:52:05.187446 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 11:52:05.189485 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.190446 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.190450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.190452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.190569 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 11:52:05.191054 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 11:52:05.191058 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 11:52:05.191060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 11:52:05.191348 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 11:52:05.191493 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:05.192134 (+ 641us) server_negotiation.cc:299] Negotiation successful
0806 11:52:05.192283 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3010,"thread_start_us":124,"threads_started":1}
W20260806 11:52:05.193981 26227 tablet.cc:2369] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:52:05.197234 26581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } } }
I20260806 11:52:05.197448 26581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:05.199129 26471 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [term 1 FOLLOWER]: Refusing update from remote peer c8cc5019b89c4d958736206c2ce16962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 11:52:05.200135 26560 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 11:52:05.202960 26594 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 11:52:05.203159 26594 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 11:52:05.205945 26523 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8cc5019b89c4d958736206c2ce16962. Latest consensus state: current_term: 1 leader_uuid: "c8cc5019b89c4d958736206c2ce16962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } } }
I20260806 11:52:05.206086 26523 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:05.207443 26365 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [term 1 FOLLOWER]: Refusing update from remote peer c8cc5019b89c4d958736206c2ce16962: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260806 11:52:05.208146 26334 tablet.cc:2369] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 11:52:05.208150 26560 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 11:52:05.213673 26560 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c8cc5019b89c4d958736206c2ce16962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } } }
I20260806 11:52:05.213847 26560 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [sys.catalog]: This master's current role is: LEADER
I20260806 11:52:05.215395 26523 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c8cc5019b89c4d958736206c2ce16962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } } }
I20260806 11:52:05.215543 26523 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:05.215879 26579 mvcc.cc:205] Tried to move back new op lower bound from 7315526144802516992 to 7315526144611057664. Current Snapshot: MvccSnapshot[applied={T|T < 7315526144802516992}]
I20260806 11:52:05.215796 26581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8cc5019b89c4d958736206c2ce16962. Latest consensus state: current_term: 1 leader_uuid: "c8cc5019b89c4d958736206c2ce16962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } } }
I20260806 11:52:05.216094 26596 mvcc.cc:205] Tried to move back new op lower bound from 7315526144802516992 to 7315526144611057664. Current Snapshot: MvccSnapshot[applied={T|T < 7315526144802516992}]
I20260806 11:52:05.216256 26581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:05.228832 26540 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c8cc5019b89c4d958736206c2ce16962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } } }
I20260806 11:52:05.229027 26540 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962 [sys.catalog]: This master's current role is: LEADER
I20260806 11:52:05.229214 26564 catalog_manager.cc:1347] Generated new cluster ID: 5cdea6f9f2aa401ca686e814ebd5fc60
I20260806 11:52:05.229274 26564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 11:52:05.232473 26581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c8cc5019b89c4d958736206c2ce16962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8cc5019b89c4d958736206c2ce16962" member_type: VOTER last_known_addr { host: "127.26.172.254" port: 41067 } } peers { permanent_uuid: "878035cc5e0349b1984bcd392633dd78" member_type: VOTER last_known_addr { host: "127.26.172.253" port: 34189 } } peers { permanent_uuid: "a2f42d39da514c1f9af7e9c318c5a7aa" member_type: VOTER last_known_addr { host: "127.26.172.252" port: 41875 } } }
I20260806 11:52:05.232646 26581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 11:52:05.236860 26598 mvcc.cc:205] Tried to move back new op lower bound from 7315526144802516992 to 7315526144611057664. Current Snapshot: MvccSnapshot[applied={T|T < 7315526144802516992}]
I20260806 11:52:05.252569 26564 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 11:52:05.255048 26564 catalog_manager.cc:1504] Loading token signing keys...
I20260806 11:52:05.272657 26564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8cc5019b89c4d958736206c2ce16962: Generated new TSK 0
I20260806 11:52:05.273921 26564 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 11:52:05.318625 26300 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.314587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53272 (local address 127.26.172.254:41067)
0806 11:52:05.314745 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.314750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.317234 (+ 2484us) server_negotiation.cc:407] Connection header received
0806 11:52:05.317511 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.317516 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.317593 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.317655 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.318453 (+ 798us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53272: BlockingRecv error: recv got EOF from 127.0.0.1:53272 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 11:52:05.320657 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.315913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51578 (local address 127.26.172.253:34189)
0806 11:52:05.316073 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.316078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.319514 (+ 3436us) server_negotiation.cc:407] Connection header received
0806 11:52:05.319715 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.319718 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.319777 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.319831 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.320493 (+ 662us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51578: BlockingRecv error: recv got EOF from 127.0.0.1:51578 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260806 11:52:05.322541 26520 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.316608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50630 (local address 127.26.172.252:41875)
0806 11:52:05.316727 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.316732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.321493 (+ 4761us) server_negotiation.cc:407] Connection header received
0806 11:52:05.321688 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.321691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.321751 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.321805 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.322386 (+ 581us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50630: BlockingRecv error: recv got EOF from 127.0.0.1:50630 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260806 11:52:05.328447 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.325724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51586 (local address 127.26.172.253:34189)
0806 11:52:05.325855 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.325859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.326572 (+ 713us) server_negotiation.cc:407] Connection header received
0806 11:52:05.326889 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.326893 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.326997 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.327064 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.328301 (+ 1237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51586: BlockingRecv error: recv got EOF from 127.0.0.1:51586 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260806 11:52:05.335088 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.333043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51596 (local address 127.26.172.253:34189)
0806 11:52:05.333190 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.333195 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.333880 (+ 685us) server_negotiation.cc:407] Connection header received
0806 11:52:05.334105 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.334109 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.334169 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.334227 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.334952 (+ 725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51596: BlockingRecv error: recv got EOF from 127.0.0.1:51596 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260806 11:52:05.342057 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.340049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51600 (local address 127.26.172.253:34189)
0806 11:52:05.340176 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.340181 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.340794 (+ 613us) server_negotiation.cc:407] Connection header received
0806 11:52:05.341022 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.341026 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.341085 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.341141 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.341918 (+ 777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51600: BlockingRecv error: recv got EOF from 127.0.0.1:51600 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260806 11:52:05.351718 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.349629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51606 (local address 127.26.172.253:34189)
0806 11:52:05.349771 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.349777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.350471 (+ 694us) server_negotiation.cc:407] Connection header received
0806 11:52:05.350708 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.350712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.350771 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.350905 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.351573 (+ 668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51606: BlockingRecv error: recv got EOF from 127.0.0.1:51606 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260806 11:52:05.365646 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.363483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51612 (local address 127.26.172.253:34189)
0806 11:52:05.363633 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.363638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.364360 (+ 722us) server_negotiation.cc:407] Connection header received
0806 11:52:05.364628 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.364632 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.364696 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.364756 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.365497 (+ 741us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51612: BlockingRecv error: recv got EOF from 127.0.0.1:51612 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260806 11:52:05.387949 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.385648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51626 (local address 127.26.172.253:34189)
0806 11:52:05.385824 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.385830 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.386469 (+ 639us) server_negotiation.cc:407] Connection header received
0806 11:52:05.386669 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.386673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.386769 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.386945 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.387766 (+ 821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51626: BlockingRecv error: recv got EOF from 127.0.0.1:51626 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260806 11:52:05.424726 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.422890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51634 (local address 127.26.172.253:34189)
0806 11:52:05.423119 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.423126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.423362 (+ 236us) server_negotiation.cc:407] Connection header received
0806 11:52:05.423707 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.423711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.423779 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.423894 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.424532 (+ 638us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51634: BlockingRecv error: recv got EOF from 127.0.0.1:51634 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 11:52:05.494510 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.492684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51638 (local address 127.26.172.253:34189)
0806 11:52:05.492882 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.492887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.493074 (+ 187us) server_negotiation.cc:407] Connection header received
0806 11:52:05.493325 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.493329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.493505 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.493664 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.494325 (+ 661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51638: BlockingRecv error: recv got EOF from 127.0.0.1:51638 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260806 11:52:05.627714 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.625820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51654 (local address 127.26.172.253:34189)
0806 11:52:05.626080 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.626084 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.626111 (+ 27us) server_negotiation.cc:407] Connection header received
0806 11:52:05.626405 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.626409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.626545 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.626666 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.627533 (+ 867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51654: BlockingRecv error: recv got EOF from 127.0.0.1:51654 (error 108)
Metrics: {"server-negotiator.queue_time_us":145}
W20260806 11:52:05.887941 26408 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 11:52:05.886595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51656 (local address 127.26.172.253:34189)
0806 11:52:05.886808 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:05.886812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:05.886886 (+ 74us) server_negotiation.cc:407] Connection header received
0806 11:52:05.886980 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:05.886983 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:05.887058 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:05.887176 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 11:52:05.887771 (+ 595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51656: BlockingRecv error: recv got EOF from 127.0.0.1:51656 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 11:52:06.099575 26537 catalog_manager.cc:1259] Loaded cluster ID: 5cdea6f9f2aa401ca686e814ebd5fc60
I20260806 11:52:06.099718 26537 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa: loading cluster ID for follower catalog manager: success
I20260806 11:52:06.101876 26537 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa: acquiring CA information for follower catalog manager: success
I20260806 11:52:06.103524 26537 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a2f42d39da514c1f9af7e9c318c5a7aa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 11:52:06.205462 26594 catalog_manager.cc:1259] Loaded cluster ID: 5cdea6f9f2aa401ca686e814ebd5fc60
I20260806 11:52:06.205601 26594 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78: loading cluster ID for follower catalog manager: success
I20260806 11:52:06.208678 26594 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78: acquiring CA information for follower catalog manager: success
I20260806 11:52:06.210565 26594 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 878035cc5e0349b1984bcd392633dd78: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 11:52:06.408502 26691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:06.402771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51670 (local address 127.26.172.253:34189)
0806 11:52:06.403255 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:06.403259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:06.403273 (+ 14us) server_negotiation.cc:407] Connection header received
0806 11:52:06.403334 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:06.403337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:06.403561 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:06.403712 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:52:06.404036 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:06.404768 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:06.405912 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:06.406193 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:06.406328 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:06.406720 (+ 392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:52:06.407458 (+ 738us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:52:06.407620 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:06.407944 (+ 324us) server_negotiation.cc:299] Negotiation successful
0806 11:52:06.408039 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":229,"threads_started":1}
I20260806 11:52:06.420269 26701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:06.413568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50636 (local address 127.26.172.252:41875)
0806 11:52:06.413954 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:06.413958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:06.413977 (+ 19us) server_negotiation.cc:407] Connection header received
0806 11:52:06.414310 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:06.414316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:06.414536 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:06.414701 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:52:06.415385 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:06.416287 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:06.417738 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:06.418114 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:06.418280 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:06.418758 (+ 478us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:52:06.419574 (+ 816us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:52:06.419740 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:06.420016 (+ 276us) server_negotiation.cc:299] Negotiation successful
0806 11:52:06.420115 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":138,"threads_started":1}
I20260806 11:52:06.430953 26691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:06.425256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51678 (local address 127.26.172.253:34189)
0806 11:52:06.425491 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:06.425496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:06.425956 (+ 460us) server_negotiation.cc:407] Connection header received
0806 11:52:06.426199 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:06.426202 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:06.426261 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:06.426402 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:52:06.426940 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:06.427756 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:06.429256 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:06.429615 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:06.429707 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:06.430311 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:52:06.430428 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:52:06.430482 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:06.430655 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 11:52:06.430717 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 11:52:06.431056 26701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:06.426090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50644 (local address 127.26.172.252:41875)
0806 11:52:06.426255 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:06.426260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:06.426521 (+ 261us) server_negotiation.cc:407] Connection header received
0806 11:52:06.426755 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:06.426759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:06.426889 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:06.426984 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:52:06.427318 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:06.428125 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:06.429327 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:06.429661 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:06.429727 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:06.430320 (+ 593us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:52:06.430447 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:52:06.430547 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:06.430730 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 11:52:06.430817 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 11:52:06.431257 26709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 11:52:06.425133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53286 (local address 127.26.172.254:41067)
0806 11:52:06.425447 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0806 11:52:06.425454 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 11:52:06.425824 (+ 370us) server_negotiation.cc:407] Connection header received
0806 11:52:06.426033 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 11:52:06.426037 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 11:52:06.426250 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 11:52:06.426403 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 11:52:06.426777 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:06.427634 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:06.428832 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 11:52:06.429145 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 11:52:06.429294 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 11:52:06.429747 (+ 453us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 11:52:06.430332 (+ 585us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 11:52:06.430450 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 11:52:06.430979 (+ 529us) server_negotiation.cc:299] Negotiation successful
0806 11:52:06.431085 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":78,"threads_started":1}
I20260806 11:52:06.436234 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 26198
I20260806 11:52:06.453799 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 26304
I20260806 11:52:06.470818 27315 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJj2CNI/build/debug/bin/kudu with pid 26409
2026-08-06T11:52:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3719 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (7462 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (339922 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST